Attachment 929174 Details for Bug 1132452 – vdsm.log

vdsm.log

vdsm.log (text/x-log), 6.18 MB, created by Yuri Obshansky on 2014-08-21 11:44:14 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Yuri Obshansky

Created: 2014-08-21 11:44:14 UTC

Size: 6.18 MB

patch

obsolete

>Thread-15::DEBUG::2014-08-21 10:01:01,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0761478 s, 6.5 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:01:01,776::task::1185::TaskManager.Task::(prepare) Task=`a6a96761-af6b-4f40-b237-4a3d63e6250b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:01:01,777::task::595::TaskManager.Task::(_updateState) Task=`a6a96761-af6b-4f40-b237-4a3d63e6250b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:01:01,778::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:01:01,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:01:01,778::task::990::TaskManager.Task::(_decref) Task=`a6a96761-af6b-4f40-b237-4a3d63e6250b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:01:01,898::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-34::DEBUG::2014-08-21 10:01:02,133::task::595::TaskManager.Task::(_updateState) Task=`3a2dd8b3-eea3-4950-af84-72bd0dd5b71b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:01:02,134::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:01:02,166::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e0a6e293-b95b-4908-a184-b560fecc03bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:01:02,167::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:01:02,183::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:01:02,184::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e0a6e293-b95b-4908-a184-b560fecc03bf`::Granted request
>Thread-34::DEBUG::2014-08-21 10:01:02,207::task::827::TaskManager.Task::(resourceAcquired) Task=`3a2dd8b3-eea3-4950-af84-72bd0dd5b71b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:01:02,208::task::990::TaskManager.Task::(_decref) Task=`3a2dd8b3-eea3-4950-af84-72bd0dd5b71b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:01:02,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:02,354::task::1185::TaskManager.Task::(prepare) Task=`3a2dd8b3-eea3-4950-af84-72bd0dd5b71b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:02,354::task::595::TaskManager.Task::(_updateState) Task=`3a2dd8b3-eea3-4950-af84-72bd0dd5b71b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:01:02,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:01:02,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:01:02,357::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:01:02,362::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:01:02,363::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:01:02,364::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:01:02,370::task::990::TaskManager.Task::(_decref) Task=`3a2dd8b3-eea3-4950-af84-72bd0dd5b71b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:01:02,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.88669 s, 543 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:01:02,619::task::595::TaskManager.Task::(_updateState) Task=`bc0ba6db-525e-4d6e-9164-87583a390ebc`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:01:02,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:01:02,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0761478', 'lastCheck': '0.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:01:02,621::task::1185::TaskManager.Task::(prepare) Task=`bc0ba6db-525e-4d6e-9164-87583a390ebc`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0761478', 'lastCheck': '0.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:01:02,621::task::595::TaskManager.Task::(_updateState) Task=`bc0ba6db-525e-4d6e-9164-87583a390ebc`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:01:02,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:01:02,622::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:01:02,622::task::990::TaskManager.Task::(_decref) Task=`bc0ba6db-525e-4d6e-9164-87583a390ebc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:01:04,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:06,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.06111 s, 965 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:08,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:08,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0920681 s, 11.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:11,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:01:12,737::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-26::DEBUG::2014-08-21 10:01:12,739::task::595::TaskManager.Task::(_updateState) Task=`82d76594-89c9-4c0f-bfe3-530e760912be`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:01:12,739::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:01:12,747::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:01:12,748::task::1185::TaskManager.Task::(prepare) Task=`82d76594-89c9-4c0f-bfe3-530e760912be`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:01:12,753::task::595::TaskManager.Task::(_updateState) Task=`82d76594-89c9-4c0f-bfe3-530e760912be`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:01:12,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:01:12,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:01:12,759::task::990::TaskManager.Task::(_decref) Task=`82d76594-89c9-4c0f-bfe3-530e760912be`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:01:14,913::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:01:14,990::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-34::DEBUG::2014-08-21 10:01:14,994::task::595::TaskManager.Task::(_updateState) Task=`918a9940-b060-472e-b8e3-2deabc2508bc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:01:14,995::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:01:14,998::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d6005a88-64f7-455e-8456-279c905affac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:01:15,000::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:01:15,008::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:01:15,009::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d6005a88-64f7-455e-8456-279c905affac`::Granted request
>Thread-34::DEBUG::2014-08-21 10:01:15,010::task::827::TaskManager.Task::(resourceAcquired) Task=`918a9940-b060-472e-b8e3-2deabc2508bc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:01:15,043::task::990::TaskManager.Task::(_decref) Task=`918a9940-b060-472e-b8e3-2deabc2508bc`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:01:15,055::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000682406 s, 730 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:01:15,376::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:15,377::task::1185::TaskManager.Task::(prepare) Task=`918a9940-b060-472e-b8e3-2deabc2508bc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:15,378::task::595::TaskManager.Task::(_updateState) Task=`918a9940-b060-472e-b8e3-2deabc2508bc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:01:15,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:01:15,380::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:01:15,394::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:01:15,396::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:01:15,396::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:01:15,397::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:01:15,398::task::990::TaskManager.Task::(_decref) Task=`918a9940-b060-472e-b8e3-2deabc2508bc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:01:15,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.35016 s, 235 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:17,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:17,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.050018 s, 20.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:19,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:20,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0595 s, 17.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:01:20,844::task::595::TaskManager.Task::(_updateState) Task=`3b71f267-5b72-494f-b9fd-dc631b51c9af`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:01:20,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:01:20,845::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682406', 'lastCheck': '5.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:01:20,845::task::1185::TaskManager.Task::(prepare) Task=`3b71f267-5b72-494f-b9fd-dc631b51c9af`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682406', 'lastCheck': '5.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:01:20,845::task::595::TaskManager.Task::(_updateState) Task=`3b71f267-5b72-494f-b9fd-dc631b51c9af`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:01:20,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:01:20,845::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:01:20,846::task::990::TaskManager.Task::(_decref) Task=`3b71f267-5b72-494f-b9fd-dc631b51c9af`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:01:22,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:01:27,805::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-26::DEBUG::2014-08-21 10:01:27,954::task::595::TaskManager.Task::(_updateState) Task=`f5979ccd-069a-488c-bc44-c0ec6c7ae9d9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:01:27,978::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:01:27,980::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:01:28,056::task::1185::TaskManager.Task::(prepare) Task=`f5979ccd-069a-488c-bc44-c0ec6c7ae9d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:01:28,057::task::595::TaskManager.Task::(_updateState) Task=`f5979ccd-069a-488c-bc44-c0ec6c7ae9d9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:01:28,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:01:28,261::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:01:28,261::task::990::TaskManager.Task::(_decref) Task=`f5979ccd-069a-488c-bc44-c0ec6c7ae9d9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:01:29,575::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 10:01:29,577::task::595::TaskManager.Task::(_updateState) Task=`3e522a6a-5958-42e4-b2d4-b1cdc125b1c0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:01:29,741::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:01:29,768::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`217cf620-19dc-49db-ac1a-48986cbc13cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:01:29,776::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:01:29,784::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:01:29,791::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`217cf620-19dc-49db-ac1a-48986cbc13cd`::Granted request
>Thread-34::DEBUG::2014-08-21 10:01:29,803::task::827::TaskManager.Task::(resourceAcquired) Task=`3e522a6a-5958-42e4-b2d4-b1cdc125b1c0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:01:29,805::task::990::TaskManager.Task::(_decref) Task=`3e522a6a-5958-42e4-b2d4-b1cdc125b1c0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:01:29,876::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:29,880::task::1185::TaskManager.Task::(prepare) Task=`3e522a6a-5958-42e4-b2d4-b1cdc125b1c0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:29,885::task::595::TaskManager.Task::(_updateState) Task=`3e522a6a-5958-42e4-b2d4-b1cdc125b1c0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:01:29,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:01:29,893::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:01:29,902::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:01:29,909::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:01:29,913::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:01:29,918::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:01:29,926::task::990::TaskManager.Task::(_decref) Task=`3e522a6a-5958-42e4-b2d4-b1cdc125b1c0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:01:29,935::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:01:30,004::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00134357 s, 371 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:30,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.76165 s, 132 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:32,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:32,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554171 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:34,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:34,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.360013 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:36,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:36,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0833485 s, 12.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:39,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:39,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0830701 s, 12.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:01:40,264::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-26::DEBUG::2014-08-21 10:01:40,287::task::595::TaskManager.Task::(_updateState) Task=`d3dbc6dc-8919-4587-a40f-b6a0fc265449`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 10:01:40,292::task::595::TaskManager.Task::(_updateState) Task=`8c9e4428-c115-4c2c-8221-b5527c77ecc2`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:01:40,298::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:01:40,302::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:01:40,313::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::INFO::2014-08-21 10:01:40,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134357', 'lastCheck': '10.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:01:40,322::task::1185::TaskManager.Task::(prepare) Task=`d3dbc6dc-8919-4587-a40f-b6a0fc265449`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:01:40,323::task::1185::TaskManager.Task::(prepare) Task=`8c9e4428-c115-4c2c-8221-b5527c77ecc2`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134357', 'lastCheck': '10.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:01:40,334::task::595::TaskManager.Task::(_updateState) Task=`d3dbc6dc-8919-4587-a40f-b6a0fc265449`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:01:40,334::task::595::TaskManager.Task::(_updateState) Task=`8c9e4428-c115-4c2c-8221-b5527c77ecc2`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:01:40,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:01:40,345::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:01:40,350::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:01:40,351::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:01:40,360::task::990::TaskManager.Task::(_decref) Task=`d3dbc6dc-8919-4587-a40f-b6a0fc265449`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:01:40,361::task::990::TaskManager.Task::(_decref) Task=`8c9e4428-c115-4c2c-8221-b5527c77ecc2`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:01:40,401::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-34::DEBUG::2014-08-21 10:01:40,417::task::595::TaskManager.Task::(_updateState) Task=`f25c44b9-51a0-44c7-927b-0e59ff5076dd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:01:40,425::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:01:40,441::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`08d35cde-971a-42cc-8480-fdf4aa6a51f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:01:40,447::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:01:40,459::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:01:40,466::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`08d35cde-971a-42cc-8480-fdf4aa6a51f0`::Granted request
>Thread-34::DEBUG::2014-08-21 10:01:40,510::task::827::TaskManager.Task::(resourceAcquired) Task=`f25c44b9-51a0-44c7-927b-0e59ff5076dd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:01:40,516::task::990::TaskManager.Task::(_decref) Task=`f25c44b9-51a0-44c7-927b-0e59ff5076dd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:01:40,630::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:40,637::task::1185::TaskManager.Task::(prepare) Task=`f25c44b9-51a0-44c7-927b-0e59ff5076dd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:40,642::task::595::TaskManager.Task::(_updateState) Task=`f25c44b9-51a0-44c7-927b-0e59ff5076dd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:01:40,648::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:01:40,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 10:01:40,665::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:01:40,667::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:01:40,697::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:01:40,707::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:01:40,713::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:01:40,724::task::990::TaskManager.Task::(_decref) Task=`f25c44b9-51a0-44c7-927b-0e59ff5076dd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:01:40,749::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00135643 s, 367 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:41,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:41,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0589561 s, 17.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:43,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:43,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0815644 s, 12.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:45,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:45,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0945332 s, 10.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:47,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:48,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.11982 s, 8.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:50,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:01:50,924::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-13::DEBUG::2014-08-21 10:01:50,925::task::595::TaskManager.Task::(_updateState) Task=`5bfa0b9b-8cb7-4ca1-b906-c8c789fa9e82`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:01:50,926::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:01:50,927::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:01:50,928::task::1185::TaskManager.Task::(prepare) Task=`5bfa0b9b-8cb7-4ca1-b906-c8c789fa9e82`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:01:50,928::task::595::TaskManager.Task::(_updateState) Task=`5bfa0b9b-8cb7-4ca1-b906-c8c789fa9e82`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:01:50,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:01:50,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:01:50,937::task::990::TaskManager.Task::(_decref) Task=`5bfa0b9b-8cb7-4ca1-b906-c8c789fa9e82`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:01:50,942::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-34::DEBUG::2014-08-21 10:01:50,943::task::595::TaskManager.Task::(_updateState) Task=`9a24451a-cbf6-4236-8854-063de5a0402d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:01:50,943::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:01:51,014::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6d0f45ff-b27a-4825-9266-e02a2c36a6fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:01:51,025::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:01:51,035::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:01:51,039::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6d0f45ff-b27a-4825-9266-e02a2c36a6fb`::Granted request
>Thread-34::DEBUG::2014-08-21 10:01:51,054::task::827::TaskManager.Task::(resourceAcquired) Task=`9a24451a-cbf6-4236-8854-063de5a0402d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:01:51,061::task::990::TaskManager.Task::(_decref) Task=`9a24451a-cbf6-4236-8854-063de5a0402d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:01:51,121::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:51,124::task::1185::TaskManager.Task::(prepare) Task=`9a24451a-cbf6-4236-8854-063de5a0402d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:01:51,128::task::595::TaskManager.Task::(_updateState) Task=`9a24451a-cbf6-4236-8854-063de5a0402d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:01:51,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:01:51,134::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:01:51,138::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:01:51,142::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:01:51,146::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:01:51,148::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:01:51,153::task::990::TaskManager.Task::(_decref) Task=`9a24451a-cbf6-4236-8854-063de5a0402d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:01:51,208::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:01:51,241::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00197878 s, 252 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:51,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.17812 s, 869 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:53,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:53,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.313663 s, 3.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:01:55,693::task::595::TaskManager.Task::(_updateState) Task=`17dd4628-767d-4d3a-bde6-5df663c3c05e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:01:55,693::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:01:55,693::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197878', 'lastCheck': '4.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:01:55,694::task::1185::TaskManager.Task::(prepare) Task=`17dd4628-767d-4d3a-bde6-5df663c3c05e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197878', 'lastCheck': '4.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:01:55,694::task::595::TaskManager.Task::(_updateState) Task=`17dd4628-767d-4d3a-bde6-5df663c3c05e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:01:55,694::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:01:55,694::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:01:55,694::task::990::TaskManager.Task::(_decref) Task=`17dd4628-767d-4d3a-bde6-5df663c3c05e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:01:55,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:56,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0874331 s, 11.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:01:58,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:01:58,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0608438 s, 16.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:00,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:02:00,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0556956 s, 18.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:02:01,486::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-13::DEBUG::2014-08-21 10:02:01,488::task::595::TaskManager.Task::(_updateState) Task=`f323ba54-2a85-4418-a170-d6379d5b0a90`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:02:01,488::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:02:01,489::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:02:01,490::task::1185::TaskManager.Task::(prepare) Task=`f323ba54-2a85-4418-a170-d6379d5b0a90`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:02:01,490::task::595::TaskManager.Task::(_updateState) Task=`f323ba54-2a85-4418-a170-d6379d5b0a90`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:02:01,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:02:01,495::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:02:01,508::task::990::TaskManager.Task::(_decref) Task=`f323ba54-2a85-4418-a170-d6379d5b0a90`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:02:01,625::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-34::DEBUG::2014-08-21 10:02:01,626::task::595::TaskManager.Task::(_updateState) Task=`faba91c4-6ef8-45ca-9121-2ea9fe3d5422`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:02:01,627::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:02:01,628::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a4a56277-343d-46f4-a06f-0a329377c252`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:02:01,629::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:02:01,630::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:02:01,630::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a4a56277-343d-46f4-a06f-0a329377c252`::Granted request
>Thread-34::DEBUG::2014-08-21 10:02:01,650::task::827::TaskManager.Task::(resourceAcquired) Task=`faba91c4-6ef8-45ca-9121-2ea9fe3d5422`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:02:01,656::task::990::TaskManager.Task::(_decref) Task=`faba91c4-6ef8-45ca-9121-2ea9fe3d5422`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:02:01,700::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:02:01,853::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:02:01,854::task::1185::TaskManager.Task::(prepare) Task=`faba91c4-6ef8-45ca-9121-2ea9fe3d5422`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:02:01,854::task::595::TaskManager.Task::(_updateState) Task=`faba91c4-6ef8-45ca-9121-2ea9fe3d5422`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:02:01,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:02:01,855::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:02:01,856::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:02:01,856::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:02:01,857::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:02:01,857::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:02:01,858::task::990::TaskManager.Task::(_decref) Task=`faba91c4-6ef8-45ca-9121-2ea9fe3d5422`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:02:01,937::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00120837 s, 412 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:02,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:02:02,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102366 s, 10.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:04,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:02:04,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0999541 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:06,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:02:07,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170261 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:09,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:02:14,805::task::595::TaskManager.Task::(_updateState) Task=`c1035a16-d183-4372-9b78-57c25aca3868`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 10:02:15,193::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-26::DEBUG::2014-08-21 10:02:16,325::task::595::TaskManager.Task::(_updateState) Task=`922f1a3f-b6d7-4332-b0b4-db2c472e6415`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:02:16,040::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:02:16,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120837', 'lastCheck': '14.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:02:16,605::task::1185::TaskManager.Task::(prepare) Task=`c1035a16-d183-4372-9b78-57c25aca3868`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120837', 'lastCheck': '14.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:02:16,607::task::595::TaskManager.Task::(_updateState) Task=`c1035a16-d183-4372-9b78-57c25aca3868`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:02:16,609::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:02:16,611::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:02:16,614::task::990::TaskManager.Task::(_decref) Task=`c1035a16-d183-4372-9b78-57c25aca3868`::ref 0 aborting False
>Thread-26::INFO::2014-08-21 10:02:16,842::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:02:17,617::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:02:17,618::task::1185::TaskManager.Task::(prepare) Task=`922f1a3f-b6d7-4332-b0b4-db2c472e6415`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:02:17,618::task::595::TaskManager.Task::(_updateState) Task=`922f1a3f-b6d7-4332-b0b4-db2c472e6415`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:02:17,618::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:02:17,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:02:17,619::task::990::TaskManager.Task::(_decref) Task=`922f1a3f-b6d7-4332-b0b4-db2c472e6415`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:02:17,938::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-34::DEBUG::2014-08-21 10:02:17,942::task::595::TaskManager.Task::(_updateState) Task=`4141546e-42f5-42f5-8b60-c2cf956acbf1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:02:17,989::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:02:18,012::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8716f5f8-2a57-49b6-8e46-de77f775e110`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:02:18,018::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:02:18,032::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:02:18,033::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8716f5f8-2a57-49b6-8e46-de77f775e110`::Granted request
>Thread-34::DEBUG::2014-08-21 10:02:18,034::task::827::TaskManager.Task::(resourceAcquired) Task=`4141546e-42f5-42f5-8b60-c2cf956acbf1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:02:18,144::task::990::TaskManager.Task::(_decref) Task=`4141546e-42f5-42f5-8b60-c2cf956acbf1`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:02:18,534::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:02:19,317::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:02:19,769::task::1185::TaskManager.Task::(prepare) Task=`4141546e-42f5-42f5-8b60-c2cf956acbf1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-15::DEBUG::2014-08-21 10:02:19,865::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000690411 s, 721 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:02:20,046::task::595::TaskManager.Task::(_updateState) Task=`4141546e-42f5-42f5-8b60-c2cf956acbf1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:02:20,205::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:02:20,304::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:02:20,682::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:02:21,042::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:02:21,050::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:02:21,051::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:02:21,134::task::990::TaskManager.Task::(_decref) Task=`4141546e-42f5-42f5-8b60-c2cf956acbf1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:02:24,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 14.5728 s, 70.3 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:26,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:02:30,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.18671 s, 321 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:02:31,907::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:02:31,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00353749 s, 141 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:02:32,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-13::DEBUG::2014-08-21 10:02:32,322::task::595::TaskManager.Task::(_updateState) Task=`a2fa2216-1dba-402e-985c-495978f657e7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:02:32,323::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:02:32,324::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:02:32,324::task::1185::TaskManager.Task::(prepare) Task=`a2fa2216-1dba-402e-985c-495978f657e7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:02:32,324::task::595::TaskManager.Task::(_updateState) Task=`a2fa2216-1dba-402e-985c-495978f657e7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:02:32,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:02:32,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:02:32,325::task::990::TaskManager.Task::(_decref) Task=`a2fa2216-1dba-402e-985c-495978f657e7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:02:32,329::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-34::DEBUG::2014-08-21 10:02:32,330::task::595::TaskManager.Task::(_updateState) Task=`f20c0141-1f6a-4380-afbe-f3159538cfdb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:02:32,330::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:02:32,331::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`573f5b2f-141f-402c-b6f1-bdf365e9302f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:02:32,331::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:02:32,331::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:02:32,332::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`573f5b2f-141f-402c-b6f1-bdf365e9302f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:02:32,333::task::827::TaskManager.Task::(resourceAcquired) Task=`f20c0141-1f6a-4380-afbe-f3159538cfdb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:02:32,333::task::990::TaskManager.Task::(_decref) Task=`f20c0141-1f6a-4380-afbe-f3159538cfdb`::ref 1 aborting False
>Dummy-33::DEBUG::2014-08-21 10:02:32,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::INFO::2014-08-21 10:02:32,361::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:02:32,362::task::1185::TaskManager.Task::(prepare) Task=`f20c0141-1f6a-4380-afbe-f3159538cfdb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:02:32,363::task::595::TaskManager.Task::(_updateState) Task=`f20c0141-1f6a-4380-afbe-f3159538cfdb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:02:32,363::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:02:32,364::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:02:32,365::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:02:32,365::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:02:32,366::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:02:32,366::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:02:32,367::task::990::TaskManager.Task::(_decref) Task=`f20c0141-1f6a-4380-afbe-f3159538cfdb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:02:32,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.056912 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:34,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:02:34,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0548345 s, 18.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:36,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:02:36,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.076133 s, 13.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:38,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:02:38,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0504463 s, 20.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:02:39,026::task::595::TaskManager.Task::(_updateState) Task=`3f35e794-d7f9-4162-af29-06576f03de5b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:02:39,027::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:02:39,028::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00353749', 'lastCheck': '7.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:02:39,028::task::1185::TaskManager.Task::(prepare) Task=`3f35e794-d7f9-4162-af29-06576f03de5b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00353749', 'lastCheck': '7.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:02:39,029::task::595::TaskManager.Task::(_updateState) Task=`3f35e794-d7f9-4162-af29-06576f03de5b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:02:39,029::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:02:39,029::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:02:39,030::task::990::TaskManager.Task::(_decref) Task=`3f35e794-d7f9-4162-af29-06576f03de5b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:02:40,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:02:43,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-26::DEBUG::2014-08-21 10:02:43,294::task::595::TaskManager.Task::(_updateState) Task=`aa01ab9f-497f-4b84-9485-958f18773ee0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:02:43,372::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:02:43,444::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:02:43,468::task::1185::TaskManager.Task::(prepare) Task=`aa01ab9f-497f-4b84-9485-958f18773ee0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:02:43,471::task::595::TaskManager.Task::(_updateState) Task=`aa01ab9f-497f-4b84-9485-958f18773ee0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:02:43,481::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:02:43,520::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:02:43,536::task::990::TaskManager.Task::(_decref) Task=`aa01ab9f-497f-4b84-9485-958f18773ee0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:02:43,578::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-34::DEBUG::2014-08-21 10:02:43,705::task::595::TaskManager.Task::(_updateState) Task=`78b9df95-5215-4b95-97f7-db54ce872207`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:02:43,740::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:02:43,764::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`843e1785-311c-4619-8f98-4b7939f9e52b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:02:43,775::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:02:43,788::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-15::DEBUG::2014-08-21 10:02:43,790::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:02:43,811::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`843e1785-311c-4619-8f98-4b7939f9e52b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:02:43,905::task::827::TaskManager.Task::(resourceAcquired) Task=`78b9df95-5215-4b95-97f7-db54ce872207`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:02:43,908::task::990::TaskManager.Task::(_decref) Task=`78b9df95-5215-4b95-97f7-db54ce872207`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:02:43,926::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00119222 s, 418 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:02:43,985::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:02:43,996::task::1185::TaskManager.Task::(prepare) Task=`78b9df95-5215-4b95-97f7-db54ce872207`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:02:44,003::task::595::TaskManager.Task::(_updateState) Task=`78b9df95-5215-4b95-97f7-db54ce872207`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:02:44,007::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:02:44,010::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:02:44,015::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:02:44,019::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:02:44,021::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:02:44,023::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:02:44,028::task::990::TaskManager.Task::(_decref) Task=`78b9df95-5215-4b95-97f7-db54ce872207`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:02:44,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.17446 s, 323 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:02:56,042::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Dummy-33::DEBUG::2014-08-21 10:02:56,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:02:56,085::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-13::DEBUG::2014-08-21 10:02:56,130::task::595::TaskManager.Task::(_updateState) Task=`c7767be4-296b-4645-bf65-a6554b6d5280`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:02:56,131::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:02:56,316::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:02:56,332::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:02:56,362::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:02:56,382::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:02:56,386::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:02:56,390::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-13::INFO::2014-08-21 10:02:56,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:02:56,400::task::1185::TaskManager.Task::(prepare) Task=`c7767be4-296b-4645-bf65-a6554b6d5280`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:02:56,404::task::595::TaskManager.Task::(_updateState) Task=`c7767be4-296b-4645-bf65-a6554b6d5280`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:02:56,420::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:02:56,444::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:02:56,479::task::990::TaskManager.Task::(_decref) Task=`c7767be4-296b-4645-bf65-a6554b6d5280`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:02:56,553::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-34::DEBUG::2014-08-21 10:02:56,555::task::595::TaskManager.Task::(_updateState) Task=`58c7848e-d73b-41ab-a3f3-592e59194970`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:02:56,642::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:02:56,654::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`afc44f34-1f0e-4753-bda6-4908feed320b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:02:56,654::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:02:56,655::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:02:56,656::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`afc44f34-1f0e-4753-bda6-4908feed320b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:02:56,657::task::827::TaskManager.Task::(resourceAcquired) Task=`58c7848e-d73b-41ab-a3f3-592e59194970`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:02:56,657::task::990::TaskManager.Task::(_decref) Task=`58c7848e-d73b-41ab-a3f3-592e59194970`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:02:56,691::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:02:56,695::task::1185::TaskManager.Task::(prepare) Task=`58c7848e-d73b-41ab-a3f3-592e59194970`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:02:56,699::task::595::TaskManager.Task::(_updateState) Task=`58c7848e-d73b-41ab-a3f3-592e59194970`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:02:56,703::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:02:56,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:02:56,715::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:02:56,720::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:02:56,724::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:02:56,728::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:02:56,734::task::990::TaskManager.Task::(_decref) Task=`58c7848e-d73b-41ab-a3f3-592e59194970`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:02:57,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:02:57,231::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00200054 s, 249 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:02:57,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.32172 s, 775 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:03,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:03:07,264::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 10:03:07,266::task::595::TaskManager.Task::(_updateState) Task=`28af7215-5e93-4927-940d-4606f113ba87`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:03:07,278::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:03:07,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:07,308::task::1185::TaskManager.Task::(prepare) Task=`28af7215-5e93-4927-940d-4606f113ba87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:07,309::task::595::TaskManager.Task::(_updateState) Task=`28af7215-5e93-4927-940d-4606f113ba87`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:03:07,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:03:07,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:03:07,311::task::990::TaskManager.Task::(_decref) Task=`28af7215-5e93-4927-940d-4606f113ba87`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:03:07,678::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-34::DEBUG::2014-08-21 10:03:07,679::task::595::TaskManager.Task::(_updateState) Task=`aee9bafd-c854-4196-8c38-5b207933aabd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:03:07,679::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:03:07,681::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`987fa39e-6988-42b5-b65d-e99c26c7404f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:03:07,681::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:03:07,684::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:03:07,684::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`987fa39e-6988-42b5-b65d-e99c26c7404f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:03:07,685::task::827::TaskManager.Task::(resourceAcquired) Task=`aee9bafd-c854-4196-8c38-5b207933aabd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:03:07,685::task::990::TaskManager.Task::(_decref) Task=`aee9bafd-c854-4196-8c38-5b207933aabd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:03:07,716::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:07,717::task::1185::TaskManager.Task::(prepare) Task=`aee9bafd-c854-4196-8c38-5b207933aabd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:07,717::task::595::TaskManager.Task::(_updateState) Task=`aee9bafd-c854-4196-8c38-5b207933aabd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:03:07,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:03:07,718::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:03:07,718::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:03:07,719::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:03:07,719::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:03:07,719::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:03:07,720::task::990::TaskManager.Task::(_decref) Task=`aee9bafd-c854-4196-8c38-5b207933aabd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:03:08,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.847959 s, 1.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:03:08,421::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:03:08,436::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000633666 s, 786 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:10,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:03:11,252::task::595::TaskManager.Task::(_updateState) Task=`bd64d75c-8a4e-4646-986a-0ad7a0f14c1a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:03:11,253::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:03:11,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633666', 'lastCheck': '2.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:03:11,408::task::1185::TaskManager.Task::(prepare) Task=`bd64d75c-8a4e-4646-986a-0ad7a0f14c1a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633666', 'lastCheck': '2.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:03:11,421::task::595::TaskManager.Task::(_updateState) Task=`bd64d75c-8a4e-4646-986a-0ad7a0f14c1a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:03:11,528::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:03:12,350::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:03:12,382::task::990::TaskManager.Task::(_decref) Task=`bd64d75c-8a4e-4646-986a-0ad7a0f14c1a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:03:14,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.61932 s, 283 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:16,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:17,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.836773 s, 1.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:03:18,033::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6feafe36]
>Thread-26::DEBUG::2014-08-21 10:03:18,034::task::595::TaskManager.Task::(_updateState) Task=`56aef75a-91bf-4983-8f82-c42b9c929404`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:03:18,035::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:03:18,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:18,036::task::1185::TaskManager.Task::(prepare) Task=`56aef75a-91bf-4983-8f82-c42b9c929404`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:18,036::task::595::TaskManager.Task::(_updateState) Task=`56aef75a-91bf-4983-8f82-c42b9c929404`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:03:18,037::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:03:18,037::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:03:18,037::task::990::TaskManager.Task::(_decref) Task=`56aef75a-91bf-4983-8f82-c42b9c929404`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:03:18,043::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6feafe36]
>Thread-34::DEBUG::2014-08-21 10:03:18,044::task::595::TaskManager.Task::(_updateState) Task=`939bb544-c3d0-4e0f-85fb-81ce33c7d0b0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:03:18,044::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:03:18,045::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fd023e8a-c181-461a-aa3f-60f0bca2d8c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:03:18,045::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:03:18,046::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:03:18,046::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fd023e8a-c181-461a-aa3f-60f0bca2d8c2`::Granted request
>Thread-34::DEBUG::2014-08-21 10:03:18,046::task::827::TaskManager.Task::(resourceAcquired) Task=`939bb544-c3d0-4e0f-85fb-81ce33c7d0b0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:03:18,047::task::990::TaskManager.Task::(_decref) Task=`939bb544-c3d0-4e0f-85fb-81ce33c7d0b0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:03:18,052::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:18,053::task::1185::TaskManager.Task::(prepare) Task=`939bb544-c3d0-4e0f-85fb-81ce33c7d0b0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:18,053::task::595::TaskManager.Task::(_updateState) Task=`939bb544-c3d0-4e0f-85fb-81ce33c7d0b0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:03:18,053::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:03:18,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:03:18,054::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:03:18,055::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:03:18,055::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:03:18,055::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:03:18,056::task::990::TaskManager.Task::(_decref) Task=`939bb544-c3d0-4e0f-85fb-81ce33c7d0b0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:03:18,465::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:03:18,485::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000873458 s, 570 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:19,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:19,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0799974 s, 12.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:21,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:23,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.47529 s, 694 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:25,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:26,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.052517 s, 19.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:03:28,081::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-26::DEBUG::2014-08-21 10:03:28,106::task::595::TaskManager.Task::(_updateState) Task=`c1a2eae7-8824-4bdb-94f1-ac769e2e88ec`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:03:28,187::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:03:28,230::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:28,237::task::1185::TaskManager.Task::(prepare) Task=`c1a2eae7-8824-4bdb-94f1-ac769e2e88ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:28,244::task::595::TaskManager.Task::(_updateState) Task=`c1a2eae7-8824-4bdb-94f1-ac769e2e88ec`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:03:28,284::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Dummy-33::DEBUG::2014-08-21 10:03:28,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:03:28,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:03:28,554::task::990::TaskManager.Task::(_decref) Task=`c1a2eae7-8824-4bdb-94f1-ac769e2e88ec`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:03:28,930::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-34::DEBUG::2014-08-21 10:03:28,936::task::595::TaskManager.Task::(_updateState) Task=`cb1a867d-fa6f-480c-99f8-9f34fad72baa`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:03:28,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:03:28,960::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3129ff32-593d-48c2-b7f2-113b92079378`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:03:28,963::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:03:28,966::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:03:28,967::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3129ff32-593d-48c2-b7f2-113b92079378`::Granted request
>Thread-34::DEBUG::2014-08-21 10:03:28,974::task::827::TaskManager.Task::(resourceAcquired) Task=`cb1a867d-fa6f-480c-99f8-9f34fad72baa`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:03:28,975::task::990::TaskManager.Task::(_decref) Task=`cb1a867d-fa6f-480c-99f8-9f34fad72baa`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:03:28,992::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-15::DEBUG::2014-08-21 10:03:28,995::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:03:28,995::task::1185::TaskManager.Task::(prepare) Task=`cb1a867d-fa6f-480c-99f8-9f34fad72baa`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:28,997::task::595::TaskManager.Task::(_updateState) Task=`cb1a867d-fa6f-480c-99f8-9f34fad72baa`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:03:29,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:03:29,025::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:03:29,037::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:03:29,045::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:03:29,059::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:03:29,061::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:03:29,062::task::990::TaskManager.Task::(_decref) Task=`cb1a867d-fa6f-480c-99f8-9f34fad72baa`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:03:29,076::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00127976 s, 389 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:03:29,262::task::595::TaskManager.Task::(_updateState) Task=`d9b71e74-2337-4352-8aac-86363352d7ec`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:03:29,263::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:03:29,264::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000873458', 'lastCheck': '10.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:03:29,264::task::1185::TaskManager.Task::(prepare) Task=`d9b71e74-2337-4352-8aac-86363352d7ec`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000873458', 'lastCheck': '10.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:03:29,344::task::595::TaskManager.Task::(_updateState) Task=`d9b71e74-2337-4352-8aac-86363352d7ec`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:03:29,346::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:03:29,347::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:03:29,347::task::990::TaskManager.Task::(_decref) Task=`d9b71e74-2337-4352-8aac-86363352d7ec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:03:30,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.69766 s, 603 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:32,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:32,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.083077 s, 12.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:34,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:35,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.403988 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:37,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:37,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0680765 s, 15.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:03:39,104::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [8cf019c]
>Thread-26::DEBUG::2014-08-21 10:03:39,105::task::595::TaskManager.Task::(_updateState) Task=`e8734195-11be-474f-adc8-b8e9a45d71d3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:03:39,106::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:03:39,106::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:39,107::task::1185::TaskManager.Task::(prepare) Task=`e8734195-11be-474f-adc8-b8e9a45d71d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:39,107::task::595::TaskManager.Task::(_updateState) Task=`e8734195-11be-474f-adc8-b8e9a45d71d3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:03:39,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:03:39,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:03:39,108::task::990::TaskManager.Task::(_decref) Task=`e8734195-11be-474f-adc8-b8e9a45d71d3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:03:39,133::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [8cf019c]
>Thread-34::DEBUG::2014-08-21 10:03:39,135::task::595::TaskManager.Task::(_updateState) Task=`1b35caa2-c541-43fd-9a50-d29e844ffd5c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:03:39,135::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:03:39,136::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`381da636-6376-4d64-8b77-8dab012a1931`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:03:39,136::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:03:39,137::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:03:39,137::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`381da636-6376-4d64-8b77-8dab012a1931`::Granted request
>Thread-34::DEBUG::2014-08-21 10:03:39,138::task::827::TaskManager.Task::(resourceAcquired) Task=`1b35caa2-c541-43fd-9a50-d29e844ffd5c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:03:39,138::task::990::TaskManager.Task::(_decref) Task=`1b35caa2-c541-43fd-9a50-d29e844ffd5c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:03:39,145::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:39,145::task::1185::TaskManager.Task::(prepare) Task=`1b35caa2-c541-43fd-9a50-d29e844ffd5c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:39,146::task::595::TaskManager.Task::(_updateState) Task=`1b35caa2-c541-43fd-9a50-d29e844ffd5c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:03:39,146::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:03:39,146::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:03:39,147::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:03:39,147::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:03:39,148::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:03:39,148::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:03:39,148::task::990::TaskManager.Task::(_decref) Task=`1b35caa2-c541-43fd-9a50-d29e844ffd5c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:03:39,399::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:03:39,420::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00599229 s, 83.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:39,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:41,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.6067 s, 637 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:43,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:43,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.159177 s, 6.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:03:45,043::task::595::TaskManager.Task::(_updateState) Task=`648a3720-e912-4087-99c4-8ddb229d03c3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:03:45,044::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:03:45,044::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00599229', 'lastCheck': '5.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:03:45,044::task::1185::TaskManager.Task::(prepare) Task=`648a3720-e912-4087-99c4-8ddb229d03c3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00599229', 'lastCheck': '5.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:03:45,045::task::595::TaskManager.Task::(_updateState) Task=`648a3720-e912-4087-99c4-8ddb229d03c3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:03:45,045::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:03:45,045::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:03:45,045::task::990::TaskManager.Task::(_decref) Task=`648a3720-e912-4087-99c4-8ddb229d03c3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:03:45,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:46,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0928408 s, 11.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:48,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:48,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111069 s, 9.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:03:49,172::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-26::DEBUG::2014-08-21 10:03:49,174::task::595::TaskManager.Task::(_updateState) Task=`4960fd9c-d126-4102-b53d-5c884b3c3081`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:03:49,174::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:03:49,175::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:49,175::task::1185::TaskManager.Task::(prepare) Task=`4960fd9c-d126-4102-b53d-5c884b3c3081`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:49,175::task::595::TaskManager.Task::(_updateState) Task=`4960fd9c-d126-4102-b53d-5c884b3c3081`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:03:49,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:03:49,176::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:03:49,176::task::990::TaskManager.Task::(_decref) Task=`4960fd9c-d126-4102-b53d-5c884b3c3081`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:03:49,181::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 10:03:49,182::task::595::TaskManager.Task::(_updateState) Task=`4ba4dbd2-0288-4e37-a19a-b56090a3e254`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:03:49,182::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:03:49,183::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`381c0b0d-2b5d-407a-b32f-812ab17f1cf8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:03:49,183::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:03:49,184::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:03:49,184::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`381c0b0d-2b5d-407a-b32f-812ab17f1cf8`::Granted request
>Thread-34::DEBUG::2014-08-21 10:03:49,185::task::827::TaskManager.Task::(resourceAcquired) Task=`4ba4dbd2-0288-4e37-a19a-b56090a3e254`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:03:49,185::task::990::TaskManager.Task::(_decref) Task=`4ba4dbd2-0288-4e37-a19a-b56090a3e254`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:03:49,192::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:49,193::task::1185::TaskManager.Task::(prepare) Task=`4ba4dbd2-0288-4e37-a19a-b56090a3e254`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:49,193::task::595::TaskManager.Task::(_updateState) Task=`4ba4dbd2-0288-4e37-a19a-b56090a3e254`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:03:49,193::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:03:49,194::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:03:49,194::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:03:49,195::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:03:49,195::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:03:49,195::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:03:49,196::task::990::TaskManager.Task::(_decref) Task=`4ba4dbd2-0288-4e37-a19a-b56090a3e254`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:03:49,445::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:03:49,503::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00625231 s, 79.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:50,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:50,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0608099 s, 16.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:52,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:52,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.167339 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:54,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:55,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.158646 s, 6.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:03:57,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:03:59,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.55011 s, 661 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:03:59,210::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14a1da75]
>Thread-26::DEBUG::2014-08-21 10:03:59,212::task::595::TaskManager.Task::(_updateState) Task=`a86dc3d9-0b7b-416a-ac01-ca5b73016239`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:03:59,213::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:03:59,213::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:59,213::task::1185::TaskManager.Task::(prepare) Task=`a86dc3d9-0b7b-416a-ac01-ca5b73016239`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:03:59,214::task::595::TaskManager.Task::(_updateState) Task=`a86dc3d9-0b7b-416a-ac01-ca5b73016239`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:03:59,214::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:03:59,214::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:03:59,214::task::990::TaskManager.Task::(_decref) Task=`a86dc3d9-0b7b-416a-ac01-ca5b73016239`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:03:59,220::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14a1da75]
>Thread-34::DEBUG::2014-08-21 10:03:59,221::task::595::TaskManager.Task::(_updateState) Task=`a1de6b67-e768-4f15-8c0a-c06267127fdc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:03:59,222::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:03:59,223::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`edcc3f8d-7c46-42ca-8d60-69b331dd11f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:03:59,223::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:03:59,223::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:03:59,224::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`edcc3f8d-7c46-42ca-8d60-69b331dd11f3`::Granted request
>Thread-34::DEBUG::2014-08-21 10:03:59,225::task::827::TaskManager.Task::(resourceAcquired) Task=`a1de6b67-e768-4f15-8c0a-c06267127fdc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:03:59,225::task::990::TaskManager.Task::(_decref) Task=`a1de6b67-e768-4f15-8c0a-c06267127fdc`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:03:59,232::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:59,233::task::1185::TaskManager.Task::(prepare) Task=`a1de6b67-e768-4f15-8c0a-c06267127fdc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:03:59,233::task::595::TaskManager.Task::(_updateState) Task=`a1de6b67-e768-4f15-8c0a-c06267127fdc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:03:59,233::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:03:59,234::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:03:59,234::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:03:59,234::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:03:59,235::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:03:59,235::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:03:59,236::task::990::TaskManager.Task::(_decref) Task=`a1de6b67-e768-4f15-8c0a-c06267127fdc`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:03:59,520::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:03:59,548::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000940161 s, 530 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:01,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:04:01,190::task::595::TaskManager.Task::(_updateState) Task=`f27eac75-eb65-47dd-ac83-6221ed1da4e7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:04:01,196::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:04:01,198::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000940161', 'lastCheck': '1.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:04:01,200::task::1185::TaskManager.Task::(prepare) Task=`f27eac75-eb65-47dd-ac83-6221ed1da4e7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000940161', 'lastCheck': '1.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:04:01,202::task::595::TaskManager.Task::(_updateState) Task=`f27eac75-eb65-47dd-ac83-6221ed1da4e7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:04:01,204::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:04:01,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:04:01,219::task::990::TaskManager.Task::(_decref) Task=`f27eac75-eb65-47dd-ac83-6221ed1da4e7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:04:01,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.269524 s, 3.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:03,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:03,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0664066 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:05,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:05,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0621016 s, 16.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:07,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:04:10,288::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-26::DEBUG::2014-08-21 10:04:10,335::task::595::TaskManager.Task::(_updateState) Task=`9abf8672-9d0a-4dd4-a36e-139293cec00d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:04:10,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:04:10,446::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:04:10,453::task::1185::TaskManager.Task::(prepare) Task=`9abf8672-9d0a-4dd4-a36e-139293cec00d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:04:10,457::task::595::TaskManager.Task::(_updateState) Task=`9abf8672-9d0a-4dd4-a36e-139293cec00d`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 10:04:10,474::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:04:10,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:04:10,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:04:10,679::task::990::TaskManager.Task::(_decref) Task=`9abf8672-9d0a-4dd4-a36e-139293cec00d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:04:10,785::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0188251 s, 26.5 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:04:10,860::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-34::DEBUG::2014-08-21 10:04:10,862::task::595::TaskManager.Task::(_updateState) Task=`c1b68dbc-daf3-4664-9de3-27dd413be707`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:04:10,862::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:04:10,864::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4a537d88-4900-4458-a788-b53f47ba290d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:04:10,864::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:04:10,865::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:04:10,866::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4a537d88-4900-4458-a788-b53f47ba290d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:04:10,867::task::827::TaskManager.Task::(resourceAcquired) Task=`c1b68dbc-daf3-4664-9de3-27dd413be707`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:04:10,872::task::990::TaskManager.Task::(_decref) Task=`c1b68dbc-daf3-4664-9de3-27dd413be707`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:04:10,915::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:10,916::task::1185::TaskManager.Task::(prepare) Task=`c1b68dbc-daf3-4664-9de3-27dd413be707`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:10,916::task::595::TaskManager.Task::(_updateState) Task=`c1b68dbc-daf3-4664-9de3-27dd413be707`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:04:10,917::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:04:10,917::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:04:10,918::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:04:10,928::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:04:10,929::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:04:10,929::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:04:10,930::task::990::TaskManager.Task::(_decref) Task=`c1b68dbc-daf3-4664-9de3-27dd413be707`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:04:11,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.30924 s, 309 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:13,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:19,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.95274 s, 172 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:04:21,092::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-13::DEBUG::2014-08-21 10:04:21,128::task::595::TaskManager.Task::(_updateState) Task=`31a73b36-ebd6-40e0-a084-9bd6081c06e8`::moving from state init -> state preparing
>Dummy-33::DEBUG::2014-08-21 10:04:21,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::INFO::2014-08-21 10:04:21,585::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:04:21,604::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:04:21,616::task::1185::TaskManager.Task::(prepare) Task=`31a73b36-ebd6-40e0-a084-9bd6081c06e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:04:21,630::task::595::TaskManager.Task::(_updateState) Task=`31a73b36-ebd6-40e0-a084-9bd6081c06e8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:04:21,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:04:21,682::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 10:04:21,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:04:21,938::task::990::TaskManager.Task::(_decref) Task=`31a73b36-ebd6-40e0-a084-9bd6081c06e8`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:04:21,987::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000531813 s, 936 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:04:22,031::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-34::DEBUG::2014-08-21 10:04:22,034::task::595::TaskManager.Task::(_updateState) Task=`4bc69a99-74ba-43f9-b990-002a21e321ec`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:04:22,035::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:04:22,036::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15a188e3-33e5-4b54-a641-6af4762d16f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:04:22,037::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:04:22,038::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:04:22,039::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15a188e3-33e5-4b54-a641-6af4762d16f5`::Granted request
>Thread-34::DEBUG::2014-08-21 10:04:22,040::task::827::TaskManager.Task::(resourceAcquired) Task=`4bc69a99-74ba-43f9-b990-002a21e321ec`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:04:22,040::task::990::TaskManager.Task::(_decref) Task=`4bc69a99-74ba-43f9-b990-002a21e321ec`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:04:22,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:22,052::task::1185::TaskManager.Task::(prepare) Task=`4bc69a99-74ba-43f9-b990-002a21e321ec`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:22,053::task::595::TaskManager.Task::(_updateState) Task=`4bc69a99-74ba-43f9-b990-002a21e321ec`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:04:22,053::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:04:22,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:04:22,056::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:04:22,057::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:04:22,057::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:04:22,058::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:04:22,059::task::990::TaskManager.Task::(_decref) Task=`4bc69a99-74ba-43f9-b990-002a21e321ec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:04:22,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.57577 s, 1.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:04:22,323::task::595::TaskManager.Task::(_updateState) Task=`b49d3319-79eb-47fe-8126-2df9c4b69995`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:04:22,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:04:22,324::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531813', 'lastCheck': '0.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:04:22,325::task::1185::TaskManager.Task::(prepare) Task=`b49d3319-79eb-47fe-8126-2df9c4b69995`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531813', 'lastCheck': '0.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:04:22,325::task::595::TaskManager.Task::(_updateState) Task=`b49d3319-79eb-47fe-8126-2df9c4b69995`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:04:22,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:04:22,326::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:04:22,326::task::990::TaskManager.Task::(_decref) Task=`b49d3319-79eb-47fe-8126-2df9c4b69995`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:04:24,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:24,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104922 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:26,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:27,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.456239 s, 2.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:29,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:29,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0828081 s, 12.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:31,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:31,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0846319 s, 12.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:04:32,078::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [56d6be71]
>Thread-13::DEBUG::2014-08-21 10:04:32,080::task::595::TaskManager.Task::(_updateState) Task=`839addb9-3125-4bb5-81a3-7632076d159d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:04:32,080::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:04:32,105::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:04:32,106::task::1185::TaskManager.Task::(prepare) Task=`839addb9-3125-4bb5-81a3-7632076d159d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:04:32,106::task::595::TaskManager.Task::(_updateState) Task=`839addb9-3125-4bb5-81a3-7632076d159d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:04:32,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:04:32,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:04:32,108::task::990::TaskManager.Task::(_decref) Task=`839addb9-3125-4bb5-81a3-7632076d159d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:04:32,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:04:32,302::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [56d6be71]
>Thread-34::DEBUG::2014-08-21 10:04:32,322::task::595::TaskManager.Task::(_updateState) Task=`f37351b4-6298-43ed-bd82-a7a7df7a083c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:04:32,323::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:04:32,325::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ebd1d86-f235-43ac-8a4a-f98fef849a4f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:04:32,325::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:04:32,412::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:04:32,413::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ebd1d86-f235-43ac-8a4a-f98fef849a4f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:04:32,414::task::827::TaskManager.Task::(resourceAcquired) Task=`f37351b4-6298-43ed-bd82-a7a7df7a083c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:04:32,419::task::990::TaskManager.Task::(_decref) Task=`f37351b4-6298-43ed-bd82-a7a7df7a083c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:04:32,589::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:32,590::task::1185::TaskManager.Task::(prepare) Task=`f37351b4-6298-43ed-bd82-a7a7df7a083c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:32,597::task::595::TaskManager.Task::(_updateState) Task=`f37351b4-6298-43ed-bd82-a7a7df7a083c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:04:32,598::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:04:32,599::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:04:32,634::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:04:32,638::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:04:32,638::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:04:32,639::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:04:32,640::task::990::TaskManager.Task::(_decref) Task=`f37351b4-6298-43ed-bd82-a7a7df7a083c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:04:33,168::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00747332 s, 66.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:33,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:34,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.067797 s, 15.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:36,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:36,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0814552 s, 12.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:04:37,600::task::595::TaskManager.Task::(_updateState) Task=`565076ec-80e9-4737-a33c-0dd3f66578d3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:04:37,600::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:04:37,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00747332', 'lastCheck': '4.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:04:37,601::task::1185::TaskManager.Task::(prepare) Task=`565076ec-80e9-4737-a33c-0dd3f66578d3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00747332', 'lastCheck': '4.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:04:37,601::task::595::TaskManager.Task::(_updateState) Task=`565076ec-80e9-4737-a33c-0dd3f66578d3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:04:37,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:04:37,601::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:04:37,602::task::990::TaskManager.Task::(_decref) Task=`565076ec-80e9-4737-a33c-0dd3f66578d3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:04:38,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:40,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.795947 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:42,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:04:43,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:04:43,881::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-13::DEBUG::2014-08-21 10:04:43,898::task::595::TaskManager.Task::(_updateState) Task=`afc23718-b3c1-4806-9dd4-fbf8a3fa2f82`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:04:43,899::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:04:43,910::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:04:43,922::task::1185::TaskManager.Task::(prepare) Task=`afc23718-b3c1-4806-9dd4-fbf8a3fa2f82`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:04:43,927::task::595::TaskManager.Task::(_updateState) Task=`afc23718-b3c1-4806-9dd4-fbf8a3fa2f82`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:04:43,988::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:04:43,991::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:04:44,972::task::990::TaskManager.Task::(_decref) Task=`afc23718-b3c1-4806-9dd4-fbf8a3fa2f82`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:04:45,593::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00645006 s, 77.2 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:04:45,703::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-34::DEBUG::2014-08-21 10:04:45,780::task::595::TaskManager.Task::(_updateState) Task=`4e7a7408-4326-4b6f-9a3b-98c2aac46710`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:04:45,785::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:04:45,831::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7c259dca-63bf-4486-b0ec-ce172ef8627e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:04:45,839::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:04:45,842::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:04:45,843::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7c259dca-63bf-4486-b0ec-ce172ef8627e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:04:45,885::task::827::TaskManager.Task::(resourceAcquired) Task=`4e7a7408-4326-4b6f-9a3b-98c2aac46710`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:04:45,887::task::990::TaskManager.Task::(_decref) Task=`4e7a7408-4326-4b6f-9a3b-98c2aac46710`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:04:45,931::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:45,932::task::1185::TaskManager.Task::(prepare) Task=`4e7a7408-4326-4b6f-9a3b-98c2aac46710`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:45,932::task::595::TaskManager.Task::(_updateState) Task=`4e7a7408-4326-4b6f-9a3b-98c2aac46710`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:04:45,933::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:04:45,933::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:04:45,939::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:04:45,941::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:04:45,942::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:04:45,943::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:04:45,945::task::990::TaskManager.Task::(_decref) Task=`4e7a7408-4326-4b6f-9a3b-98c2aac46710`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:04:46,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.89868 s, 263 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:48,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:48,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.167852 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:50,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:51,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.335059 s, 3.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:53,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:53,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0759726 s, 13.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:04:54,660::task::595::TaskManager.Task::(_updateState) Task=`bbc6ca16-5cbe-48f5-8404-09ec7f9435dc`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:04:54,661::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:04:54,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00645006', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:04:54,662::task::1185::TaskManager.Task::(prepare) Task=`bbc6ca16-5cbe-48f5-8404-09ec7f9435dc`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00645006', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:04:54,662::task::595::TaskManager.Task::(_updateState) Task=`bbc6ca16-5cbe-48f5-8404-09ec7f9435dc`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:04:54,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:04:54,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:04:54,663::task::990::TaskManager.Task::(_decref) Task=`bbc6ca16-5cbe-48f5-8404-09ec7f9435dc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:04:55,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:04:56,149::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-26::DEBUG::2014-08-21 10:04:56,150::task::595::TaskManager.Task::(_updateState) Task=`6f601673-42b3-41c9-a344-8dd28f748995`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:04:56,151::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:04:56,151::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:04:56,152::task::1185::TaskManager.Task::(prepare) Task=`6f601673-42b3-41c9-a344-8dd28f748995`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:04:56,152::task::595::TaskManager.Task::(_updateState) Task=`6f601673-42b3-41c9-a344-8dd28f748995`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:04:56,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:04:56,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:04:56,153::task::990::TaskManager.Task::(_decref) Task=`6f601673-42b3-41c9-a344-8dd28f748995`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:04:56,283::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 10:04:56,337::task::595::TaskManager.Task::(_updateState) Task=`a7c3f855-b97c-4080-8cf9-93750976d69e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:04:56,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:04:56,339::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b8b50b7e-18da-44d3-84eb-ef3ce06d197f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:04:56,340::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:04:56,341::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:04:56,341::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b8b50b7e-18da-44d3-84eb-ef3ce06d197f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:04:56,440::task::827::TaskManager.Task::(resourceAcquired) Task=`a7c3f855-b97c-4080-8cf9-93750976d69e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:04:56,464::task::990::TaskManager.Task::(_decref) Task=`a7c3f855-b97c-4080-8cf9-93750976d69e`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:04:56,493::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:04:56,552::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00704321 s, 70.7 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:04:56,552::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:56,559::task::1185::TaskManager.Task::(prepare) Task=`a7c3f855-b97c-4080-8cf9-93750976d69e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:04:56,561::task::595::TaskManager.Task::(_updateState) Task=`a7c3f855-b97c-4080-8cf9-93750976d69e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:04:56,562::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:04:56,563::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:04:56,567::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:04:56,572::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:04:56,574::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:04:56,579::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:04:56,588::task::990::TaskManager.Task::(_decref) Task=`a7c3f855-b97c-4080-8cf9-93750976d69e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:04:56,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.27608 s, 802 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:04:58,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:04:58,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0867471 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:01,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:04,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.52746 s, 670 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:06,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:06,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0709177 s, 14.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:05:06,612::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:05:06,629::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-26::DEBUG::2014-08-21 10:05:06,631::task::595::TaskManager.Task::(_updateState) Task=`331dc1b6-819e-4b58-ae3a-af263e5513b1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:05:06,631::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:05:06,632::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:05:06,632::task::1185::TaskManager.Task::(prepare) Task=`331dc1b6-819e-4b58-ae3a-af263e5513b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:05:06,632::task::595::TaskManager.Task::(_updateState) Task=`331dc1b6-819e-4b58-ae3a-af263e5513b1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:05:06,632::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:05:06,633::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:05:06,633::task::990::TaskManager.Task::(_decref) Task=`331dc1b6-819e-4b58-ae3a-af263e5513b1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:05:06,637::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-34::DEBUG::2014-08-21 10:05:06,637::task::595::TaskManager.Task::(_updateState) Task=`fd7a9e2a-f093-4cf5-a30c-ec8f59d9a774`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:05:06,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:05:06,638::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6b8c84cb-784c-4806-b75b-3e6af22d792e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:05:06,638::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:05:06,638::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:05:06,639::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6b8c84cb-784c-4806-b75b-3e6af22d792e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:05:06,639::task::827::TaskManager.Task::(resourceAcquired) Task=`fd7a9e2a-f093-4cf5-a30c-ec8f59d9a774`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:05:06,639::task::990::TaskManager.Task::(_decref) Task=`fd7a9e2a-f093-4cf5-a30c-ec8f59d9a774`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:05:06,646::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:06,646::task::1185::TaskManager.Task::(prepare) Task=`fd7a9e2a-f093-4cf5-a30c-ec8f59d9a774`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:06,647::task::595::TaskManager.Task::(_updateState) Task=`fd7a9e2a-f093-4cf5-a30c-ec8f59d9a774`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:05:06,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:05:06,648::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:05:06,649::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:05:06,649::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:05:06,649::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:05:06,650::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:05:06,650::task::990::TaskManager.Task::(_decref) Task=`fd7a9e2a-f093-4cf5-a30c-ec8f59d9a774`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:05:06,676::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0163634 s, 30.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:08,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:08,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.149485 s, 6.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:10,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:11,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.623535 s, 1.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:05:12,376::task::595::TaskManager.Task::(_updateState) Task=`c11b05cd-ca4b-490f-8779-fbb3dc896651`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:05:12,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:05:12,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0163634', 'lastCheck': '5.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:05:12,378::task::1185::TaskManager.Task::(prepare) Task=`c11b05cd-ca4b-490f-8779-fbb3dc896651`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0163634', 'lastCheck': '5.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:05:12,378::task::595::TaskManager.Task::(_updateState) Task=`c11b05cd-ca4b-490f-8779-fbb3dc896651`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:05:12,378::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:05:12,379::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:05:12,379::task::990::TaskManager.Task::(_decref) Task=`c11b05cd-ca4b-490f-8779-fbb3dc896651`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:05:13,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:14,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137443 s, 7.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:16,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:16,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541114 s, 18.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:05:16,696::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:05:16,711::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-26::DEBUG::2014-08-21 10:05:16,716::task::595::TaskManager.Task::(_updateState) Task=`b98a0007-53a1-44e5-912f-3e170cc3fdd9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:05:16,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:05:16,720::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:05:16,721::task::1185::TaskManager.Task::(prepare) Task=`b98a0007-53a1-44e5-912f-3e170cc3fdd9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:05:16,722::task::595::TaskManager.Task::(_updateState) Task=`b98a0007-53a1-44e5-912f-3e170cc3fdd9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:05:16,723::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:05:16,725::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:05:16,727::task::990::TaskManager.Task::(_decref) Task=`b98a0007-53a1-44e5-912f-3e170cc3fdd9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:05:16,730::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00194667 s, 256 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:05:16,736::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-34::DEBUG::2014-08-21 10:05:16,737::task::595::TaskManager.Task::(_updateState) Task=`6c6b9ef6-8211-4c0c-bbb9-87ea010015df`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:05:16,737::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:05:16,737::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`53c7f9bf-a7b3-47fb-bc71-1b55fd9a2186`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:05:16,738::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:05:16,738::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:05:16,738::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`53c7f9bf-a7b3-47fb-bc71-1b55fd9a2186`::Granted request
>Thread-34::DEBUG::2014-08-21 10:05:16,739::task::827::TaskManager.Task::(resourceAcquired) Task=`6c6b9ef6-8211-4c0c-bbb9-87ea010015df`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:05:16,739::task::990::TaskManager.Task::(_decref) Task=`6c6b9ef6-8211-4c0c-bbb9-87ea010015df`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:05:16,743::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:16,743::task::1185::TaskManager.Task::(prepare) Task=`6c6b9ef6-8211-4c0c-bbb9-87ea010015df`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:16,743::task::595::TaskManager.Task::(_updateState) Task=`6c6b9ef6-8211-4c0c-bbb9-87ea010015df`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:05:16,744::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:05:16,744::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:05:16,744::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:05:16,744::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:05:16,745::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:05:16,745::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:05:16,745::task::990::TaskManager.Task::(_decref) Task=`6c6b9ef6-8211-4c0c-bbb9-87ea010015df`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:05:18,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:18,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0608037 s, 16.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:20,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:20,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.130286 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:22,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:22,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0798058 s, 12.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:24,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:25,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.144035 s, 7.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:05:26,764::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:05:26,801::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [464d05c]
>Thread-26::DEBUG::2014-08-21 10:05:26,803::task::595::TaskManager.Task::(_updateState) Task=`355ae256-fec7-46ec-bcb1-912b9361b2e3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:05:26,803::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:05:26,826::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:05:26,827::task::1185::TaskManager.Task::(prepare) Task=`355ae256-fec7-46ec-bcb1-912b9361b2e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:05:26,828::task::595::TaskManager.Task::(_updateState) Task=`355ae256-fec7-46ec-bcb1-912b9361b2e3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:05:26,829::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:05:26,830::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:05:26,831::task::990::TaskManager.Task::(_decref) Task=`355ae256-fec7-46ec-bcb1-912b9361b2e3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:05:26,835::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.02214 s, 22.5 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:05:26,837::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [464d05c]
>Thread-34::DEBUG::2014-08-21 10:05:26,850::task::595::TaskManager.Task::(_updateState) Task=`cc70f750-7439-407b-99a6-1b58370d9ed0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:05:26,861::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:05:26,866::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cae5bedc-4f89-4a74-8ab1-8ce1cccdc180`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:05:26,866::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:05:26,870::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:05:26,871::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cae5bedc-4f89-4a74-8ab1-8ce1cccdc180`::Granted request
>Thread-34::DEBUG::2014-08-21 10:05:26,894::task::827::TaskManager.Task::(resourceAcquired) Task=`cc70f750-7439-407b-99a6-1b58370d9ed0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:05:26,895::task::990::TaskManager.Task::(_decref) Task=`cc70f750-7439-407b-99a6-1b58370d9ed0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:05:26,903::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:26,903::task::1185::TaskManager.Task::(prepare) Task=`cc70f750-7439-407b-99a6-1b58370d9ed0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:26,918::task::595::TaskManager.Task::(_updateState) Task=`cc70f750-7439-407b-99a6-1b58370d9ed0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:05:26,928::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:05:26,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:05:26,931::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:05:26,932::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:05:26,932::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:05:26,932::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:05:26,933::task::990::TaskManager.Task::(_decref) Task=`cc70f750-7439-407b-99a6-1b58370d9ed0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:05:27,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:05:33,224::task::595::TaskManager.Task::(_updateState) Task=`a708e30c-ae7c-4315-b3b0-7dbdaf03feb0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:05:33,225::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:05:33,226::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.02214', 'lastCheck': '6.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:05:33,294::task::1185::TaskManager.Task::(prepare) Task=`a708e30c-ae7c-4315-b3b0-7dbdaf03feb0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.02214', 'lastCheck': '6.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:05:33,301::task::595::TaskManager.Task::(_updateState) Task=`a708e30c-ae7c-4315-b3b0-7dbdaf03feb0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:05:33,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:05:33,357::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:05:33,358::task::990::TaskManager.Task::(_decref) Task=`a708e30c-ae7c-4315-b3b0-7dbdaf03feb0`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:05:37,594::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-13::DEBUG::2014-08-21 10:05:37,597::task::595::TaskManager.Task::(_updateState) Task=`3d254f08-9677-4476-98f1-a93c40f32241`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:05:37,612::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:05:37,613::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:05:37,614::task::1185::TaskManager.Task::(prepare) Task=`3d254f08-9677-4476-98f1-a93c40f32241`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:05:37,615::task::595::TaskManager.Task::(_updateState) Task=`3d254f08-9677-4476-98f1-a93c40f32241`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:05:37,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:05:37,664::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:05:37,871::task::990::TaskManager.Task::(_decref) Task=`3d254f08-9677-4476-98f1-a93c40f32241`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:05:38,259::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 10:05:38,294::task::595::TaskManager.Task::(_updateState) Task=`a585ac7e-a491-4e32-9b7c-54f8529a34dd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:05:38,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:05:38,452::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`498ce20d-ed2b-451e-807a-667f0ac192ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:05:38,454::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:05:38,461::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:05:38,492::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`498ce20d-ed2b-451e-807a-667f0ac192ed`::Granted request
>Thread-34::DEBUG::2014-08-21 10:05:38,504::task::827::TaskManager.Task::(resourceAcquired) Task=`a585ac7e-a491-4e32-9b7c-54f8529a34dd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:05:38,532::task::990::TaskManager.Task::(_decref) Task=`a585ac7e-a491-4e32-9b7c-54f8529a34dd`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:05:38,523::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:05:39,087::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00320905 s, 155 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:05:40,052::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:40,053::task::1185::TaskManager.Task::(prepare) Task=`a585ac7e-a491-4e32-9b7c-54f8529a34dd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:40,053::task::595::TaskManager.Task::(_updateState) Task=`a585ac7e-a491-4e32-9b7c-54f8529a34dd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:05:40,054::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:05:40,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:05:40,055::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:05:40,055::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:05:40,055::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:05:40,056::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:05:40,056::task::990::TaskManager.Task::(_decref) Task=`a585ac7e-a491-4e32-9b7c-54f8529a34dd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:05:41,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 13.3739 s, 76.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:43,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:46,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.5256 s, 405 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:48,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:05:48,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.073352 s, 14.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:52,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:05:52,752::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-13::DEBUG::2014-08-21 10:05:53,364::task::595::TaskManager.Task::(_updateState) Task=`494c4aaa-df40-4636-ba4c-9ebf1aee08ae`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:05:53,379::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:05:53,673::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::INFO::2014-08-21 10:05:54,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:05:54,308::task::1185::TaskManager.Task::(prepare) Task=`494c4aaa-df40-4636-ba4c-9ebf1aee08ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:05:54,400::task::595::TaskManager.Task::(_updateState) Task=`494c4aaa-df40-4636-ba4c-9ebf1aee08ae`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:05:54,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:05:54,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:05:54,441::task::990::TaskManager.Task::(_decref) Task=`494c4aaa-df40-4636-ba4c-9ebf1aee08ae`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:05:54,738::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-34::DEBUG::2014-08-21 10:05:54,749::task::595::TaskManager.Task::(_updateState) Task=`4f26d951-0abc-4848-bf50-5acaf091b0ae`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:05:54,756::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:05:54,758::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2d2b4fd6-a3e4-4e43-abe1-e38fb8044cfe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:05:54,759::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:05:54,815::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:05:55,207::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2d2b4fd6-a3e4-4e43-abe1-e38fb8044cfe`::Granted request
>Thread-34::DEBUG::2014-08-21 10:05:55,209::task::827::TaskManager.Task::(resourceAcquired) Task=`4f26d951-0abc-4848-bf50-5acaf091b0ae`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:05:55,209::task::990::TaskManager.Task::(_decref) Task=`4f26d951-0abc-4848-bf50-5acaf091b0ae`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:05:55,270::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:55,270::task::1185::TaskManager.Task::(prepare) Task=`4f26d951-0abc-4848-bf50-5acaf091b0ae`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:05:55,271::task::595::TaskManager.Task::(_updateState) Task=`4f26d951-0abc-4848-bf50-5acaf091b0ae`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:05:55,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:05:55,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:05:55,277::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:05:55,283::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:05:55,284::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:05:55,284::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:05:55,284::task::990::TaskManager.Task::(_decref) Task=`4f26d951-0abc-4848-bf50-5acaf091b0ae`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:05:55,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.018608 s, 26.8 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:05:56,230::task::595::TaskManager.Task::(_updateState) Task=`ed9b255a-949b-4958-afad-218b626bcb4d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:05:56,230::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:05:56,231::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.018608', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:05:56,237::task::1185::TaskManager.Task::(prepare) Task=`ed9b255a-949b-4958-afad-218b626bcb4d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.018608', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:05:56,237::task::595::TaskManager.Task::(_updateState) Task=`ed9b255a-949b-4958-afad-218b626bcb4d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:05:56,237::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:05:56,238::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:05:56,238::task::990::TaskManager.Task::(_decref) Task=`ed9b255a-949b-4958-afad-218b626bcb4d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:05:56,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.56932 s, 287 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:05:58,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:01,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.78695 s, 367 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:04,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:05,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.471029 s, 2.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:06:05,692::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-13::DEBUG::2014-08-21 10:06:05,693::task::595::TaskManager.Task::(_updateState) Task=`1faf4fa5-9bce-439d-b5be-d646cea642bf`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:06:05,694::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:06:05,695::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:06:05,695::task::1185::TaskManager.Task::(prepare) Task=`1faf4fa5-9bce-439d-b5be-d646cea642bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:06:05,695::task::595::TaskManager.Task::(_updateState) Task=`1faf4fa5-9bce-439d-b5be-d646cea642bf`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:06:05,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:06:05,696::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:06:05,696::task::990::TaskManager.Task::(_decref) Task=`1faf4fa5-9bce-439d-b5be-d646cea642bf`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:06:05,701::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-34::DEBUG::2014-08-21 10:06:05,701::task::595::TaskManager.Task::(_updateState) Task=`46c0d157-566b-4348-9f68-a6cd7590acd9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:06:05,701::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:06:05,702::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`503bf25b-5cf7-479c-8df3-252074f77729`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:06:05,702::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:06:05,703::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:06:05,703::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`503bf25b-5cf7-479c-8df3-252074f77729`::Granted request
>Thread-34::DEBUG::2014-08-21 10:06:05,703::task::827::TaskManager.Task::(resourceAcquired) Task=`46c0d157-566b-4348-9f68-a6cd7590acd9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:06:05,703::task::990::TaskManager.Task::(_decref) Task=`46c0d157-566b-4348-9f68-a6cd7590acd9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:06:05,708::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:05,708::task::1185::TaskManager.Task::(prepare) Task=`46c0d157-566b-4348-9f68-a6cd7590acd9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:05,708::task::595::TaskManager.Task::(_updateState) Task=`46c0d157-566b-4348-9f68-a6cd7590acd9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:06:05,709::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:06:05,709::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:06:05,709::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:06:05,709::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:06:05,710::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:06:05,710::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:06:05,710::task::990::TaskManager.Task::(_decref) Task=`46c0d157-566b-4348-9f68-a6cd7590acd9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:06:05,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:06:05,882::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000464705 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:07,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:07,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.061447 s, 16.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:09,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:11,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.08613 s, 943 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:13,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:13,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.166508 s, 6.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:06:14,543::task::595::TaskManager.Task::(_updateState) Task=`37a432eb-52c0-4cf3-aaa6-393df7767789`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:06:14,544::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:06:14,544::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464705', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:06:14,544::task::1185::TaskManager.Task::(prepare) Task=`37a432eb-52c0-4cf3-aaa6-393df7767789`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464705', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:06:14,545::task::595::TaskManager.Task::(_updateState) Task=`37a432eb-52c0-4cf3-aaa6-393df7767789`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:06:14,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:06:14,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:06:14,545::task::990::TaskManager.Task::(_decref) Task=`37a432eb-52c0-4cf3-aaa6-393df7767789`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:06:15,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:06:15,740::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-13::DEBUG::2014-08-21 10:06:15,748::task::595::TaskManager.Task::(_updateState) Task=`ee53d9a1-8ed3-4c65-94f6-9f2d1ce02e41`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:06:15,749::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:06:15,750::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:06:15,750::task::1185::TaskManager.Task::(prepare) Task=`ee53d9a1-8ed3-4c65-94f6-9f2d1ce02e41`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:06:15,750::task::595::TaskManager.Task::(_updateState) Task=`ee53d9a1-8ed3-4c65-94f6-9f2d1ce02e41`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:06:15,751::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:06:15,751::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:06:15,751::task::990::TaskManager.Task::(_decref) Task=`ee53d9a1-8ed3-4c65-94f6-9f2d1ce02e41`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:06:15,766::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-34::DEBUG::2014-08-21 10:06:15,768::task::595::TaskManager.Task::(_updateState) Task=`e3679a46-1ae6-47ae-9837-5f1088676237`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:06:15,768::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:06:15,769::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b0468eb8-87e1-4001-8ad0-e766446323d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:06:15,770::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:06:15,777::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:06:15,777::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b0468eb8-87e1-4001-8ad0-e766446323d9`::Granted request
>Thread-34::DEBUG::2014-08-21 10:06:15,778::task::827::TaskManager.Task::(resourceAcquired) Task=`e3679a46-1ae6-47ae-9837-5f1088676237`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:06:15,779::task::990::TaskManager.Task::(_decref) Task=`e3679a46-1ae6-47ae-9837-5f1088676237`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:06:15,789::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:15,789::task::1185::TaskManager.Task::(prepare) Task=`e3679a46-1ae6-47ae-9837-5f1088676237`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:15,790::task::595::TaskManager.Task::(_updateState) Task=`e3679a46-1ae6-47ae-9837-5f1088676237`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:06:15,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:06:15,791::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:06:15,791::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:06:15,791::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:06:15,792::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:06:15,792::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:06:15,792::task::990::TaskManager.Task::(_decref) Task=`e3679a46-1ae6-47ae-9837-5f1088676237`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:06:16,269::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:06:16,311::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000429229 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:16,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.241268 s, 4.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:18,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:18,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128699 s, 8.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:20,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:20,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10633 s, 9.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:22,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:22,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0532729 s, 19.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:25,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:25,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.205832 s, 5.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:06:27,984::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-13::DEBUG::2014-08-21 10:06:27,985::task::595::TaskManager.Task::(_updateState) Task=`45d2f159-2c8e-45c9-a52a-f3afe1a80042`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:06:27,988::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:06:28,210::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:06:28,211::task::1185::TaskManager.Task::(prepare) Task=`45d2f159-2c8e-45c9-a52a-f3afe1a80042`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:06:28,223::task::595::TaskManager.Task::(_updateState) Task=`45d2f159-2c8e-45c9-a52a-f3afe1a80042`::moving from state preparing -> state finished
>Dummy-33::DEBUG::2014-08-21 10:06:28,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:06:28,840::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:06:28,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:06:28,948::task::990::TaskManager.Task::(_decref) Task=`45d2f159-2c8e-45c9-a52a-f3afe1a80042`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:06:29,194::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 10:06:29,196::task::595::TaskManager.Task::(_updateState) Task=`eca77c5f-068d-440c-9a2f-42b128247976`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:06:29,197::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:06:29,198::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`10f89f8a-a8e1-4a63-9d77-3531ef082492`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:06:29,199::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:06:29,200::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:06:29,201::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`10f89f8a-a8e1-4a63-9d77-3531ef082492`::Granted request
>Thread-34::DEBUG::2014-08-21 10:06:29,202::task::827::TaskManager.Task::(resourceAcquired) Task=`eca77c5f-068d-440c-9a2f-42b128247976`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:06:29,222::task::990::TaskManager.Task::(_decref) Task=`eca77c5f-068d-440c-9a2f-42b128247976`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:06:29,465::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:29,471::task::1185::TaskManager.Task::(prepare) Task=`eca77c5f-068d-440c-9a2f-42b128247976`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:29,480::task::595::TaskManager.Task::(_updateState) Task=`eca77c5f-068d-440c-9a2f-42b128247976`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:06:29,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:06:29,490::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:06:29,493::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:06:29,498::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:06:29,502::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:06:29,513::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:06:29,527::task::990::TaskManager.Task::(_decref) Task=`eca77c5f-068d-440c-9a2f-42b128247976`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:06:29,552::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:06:29,578::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000406552 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:29,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.728954 s, 1.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:06:31,510::task::595::TaskManager.Task::(_updateState) Task=`8a690459-22ef-424c-a216-f6e8a28a9fd7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:06:31,511::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:06:31,511::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406552', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:06:31,511::task::1185::TaskManager.Task::(prepare) Task=`8a690459-22ef-424c-a216-f6e8a28a9fd7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406552', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:06:31,511::task::595::TaskManager.Task::(_updateState) Task=`8a690459-22ef-424c-a216-f6e8a28a9fd7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:06:31,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:06:31,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:06:31,512::task::990::TaskManager.Task::(_decref) Task=`8a690459-22ef-424c-a216-f6e8a28a9fd7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:06:31,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:31,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0788055 s, 13.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:33,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:34,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.221111 s, 4.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:36,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:36,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0872402 s, 11.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:38,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:38,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0620245 s, 16.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:06:39,566::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2b31c94b]
>Thread-13::DEBUG::2014-08-21 10:06:39,568::task::595::TaskManager.Task::(_updateState) Task=`a5e586ff-9f01-4583-8ea2-1a3275433001`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:06:39,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:06:39,570::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:06:39,570::task::1185::TaskManager.Task::(prepare) Task=`a5e586ff-9f01-4583-8ea2-1a3275433001`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:06:39,571::task::595::TaskManager.Task::(_updateState) Task=`a5e586ff-9f01-4583-8ea2-1a3275433001`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:06:39,571::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:06:39,571::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:06:39,572::task::990::TaskManager.Task::(_decref) Task=`a5e586ff-9f01-4583-8ea2-1a3275433001`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:06:39,577::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2b31c94b]
>Thread-34::DEBUG::2014-08-21 10:06:39,578::task::595::TaskManager.Task::(_updateState) Task=`51400098-1627-4ba4-836c-8b5848624376`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:06:39,579::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:06:39,581::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fa3df134-1fbe-4a42-b805-9b7872e093ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:06:39,582::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:06:39,582::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:06:39,583::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fa3df134-1fbe-4a42-b805-9b7872e093ad`::Granted request
>Thread-34::DEBUG::2014-08-21 10:06:39,584::task::827::TaskManager.Task::(resourceAcquired) Task=`51400098-1627-4ba4-836c-8b5848624376`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:06:39,584::task::990::TaskManager.Task::(_decref) Task=`51400098-1627-4ba4-836c-8b5848624376`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:06:39,824::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:39,825::task::1185::TaskManager.Task::(prepare) Task=`51400098-1627-4ba4-836c-8b5848624376`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:39,826::task::595::TaskManager.Task::(_updateState) Task=`51400098-1627-4ba4-836c-8b5848624376`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:06:39,827::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:06:39,827::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:06:39,849::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:06:39,853::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:06:39,855::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:06:39,857::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:06:39,860::task::990::TaskManager.Task::(_decref) Task=`51400098-1627-4ba4-836c-8b5848624376`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:06:39,873::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:06:39,891::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000945211 s, 527 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:40,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:40,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0569123 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:42,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:43,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0726544 s, 14.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:45,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:06:47,927::task::595::TaskManager.Task::(_updateState) Task=`ec07e9bd-9cce-48cf-bd84-3502ac5a9608`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:06:48,166::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:06:48,269::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945211', 'lastCheck': '8.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:06:48,428::task::1185::TaskManager.Task::(prepare) Task=`ec07e9bd-9cce-48cf-bd84-3502ac5a9608`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945211', 'lastCheck': '8.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:06:48,466::task::595::TaskManager.Task::(_updateState) Task=`ec07e9bd-9cce-48cf-bd84-3502ac5a9608`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:06:48,536::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:06:48,608::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:06:48,692::task::990::TaskManager.Task::(_decref) Task=`ec07e9bd-9cce-48cf-bd84-3502ac5a9608`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:06:50,074::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-26::DEBUG::2014-08-21 10:06:50,076::task::595::TaskManager.Task::(_updateState) Task=`f09686c6-da90-4fbb-b0e6-ec8c1c2adecd`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:06:50,077::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:06:50,083::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:06:50,083::task::1185::TaskManager.Task::(prepare) Task=`f09686c6-da90-4fbb-b0e6-ec8c1c2adecd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:06:50,084::task::595::TaskManager.Task::(_updateState) Task=`f09686c6-da90-4fbb-b0e6-ec8c1c2adecd`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:06:50,084::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:06:50,084::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:06:50,085::task::990::TaskManager.Task::(_decref) Task=`f09686c6-da90-4fbb-b0e6-ec8c1c2adecd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:06:50,823::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:06:50,899::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 10:06:50,923::task::595::TaskManager.Task::(_updateState) Task=`710686d6-a921-4718-a803-1051f0f47f5d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:06:51,752::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:06:51,768::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00892819 s, 55.8 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:06:52,021::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c907e678-4686-4147-85e5-fed5e18f127a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:06:52,039::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:06:52,204::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:06:52,205::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c907e678-4686-4147-85e5-fed5e18f127a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:06:52,261::task::827::TaskManager.Task::(resourceAcquired) Task=`710686d6-a921-4718-a803-1051f0f47f5d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:06:52,262::task::990::TaskManager.Task::(_decref) Task=`710686d6-a921-4718-a803-1051f0f47f5d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:06:52,309::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:52,310::task::1185::TaskManager.Task::(prepare) Task=`710686d6-a921-4718-a803-1051f0f47f5d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:06:52,310::task::595::TaskManager.Task::(_updateState) Task=`710686d6-a921-4718-a803-1051f0f47f5d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:06:52,311::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:06:52,311::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:06:52,312::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:06:52,312::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:06:52,313::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:06:52,313::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:06:52,314::task::990::TaskManager.Task::(_decref) Task=`710686d6-a921-4718-a803-1051f0f47f5d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:06:53,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.08925 s, 201 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:55,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:06:55,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.534988 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:06:58,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:07:03,851::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-26::DEBUG::2014-08-21 10:07:03,853::task::595::TaskManager.Task::(_updateState) Task=`0f828c97-bed6-4e16-b22e-9d03b632134f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:07:04,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:07:06,043::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:07:06,189::task::1185::TaskManager.Task::(prepare) Task=`0f828c97-bed6-4e16-b22e-9d03b632134f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:07:06,569::task::595::TaskManager.Task::(_updateState) Task=`0f828c97-bed6-4e16-b22e-9d03b632134f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:07:07,249::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:07:07,250::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:07:07,250::task::990::TaskManager.Task::(_decref) Task=`0f828c97-bed6-4e16-b22e-9d03b632134f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:07:07,443::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:07:13,831::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0387154 s, 12.9 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:07:17,427::task::595::TaskManager.Task::(_updateState) Task=`0da2eeda-c6bc-4674-8840-02a02ffef863`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:07:17,494::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:07:17,624::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00892819', 'lastCheck': '25.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:07:17,650::task::1185::TaskManager.Task::(prepare) Task=`0da2eeda-c6bc-4674-8840-02a02ffef863`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00892819', 'lastCheck': '25.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:07:17,679::task::595::TaskManager.Task::(_updateState) Task=`0da2eeda-c6bc-4674-8840-02a02ffef863`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:07:17,687::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:07:17,846::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:07:21,349::task::990::TaskManager.Task::(_decref) Task=`0da2eeda-c6bc-4674-8840-02a02ffef863`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:07:17,931::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 10:07:21,439::task::595::TaskManager.Task::(_updateState) Task=`ebe1f778-6b6e-4c57-b4ce-b8319ed95bda`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:07:21,440::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:07:21,441::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`13d7265c-83c8-4952-bcda-16e640a4621b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:07:21,441::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:07:21,444::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:07:21,444::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`13d7265c-83c8-4952-bcda-16e640a4621b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:07:21,445::task::827::TaskManager.Task::(resourceAcquired) Task=`ebe1f778-6b6e-4c57-b4ce-b8319ed95bda`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:07:21,446::task::990::TaskManager.Task::(_decref) Task=`ebe1f778-6b6e-4c57-b4ce-b8319ed95bda`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:07:21,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:07:21,539::task::1185::TaskManager.Task::(prepare) Task=`ebe1f778-6b6e-4c57-b4ce-b8319ed95bda`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:07:21,544::task::595::TaskManager.Task::(_updateState) Task=`ebe1f778-6b6e-4c57-b4ce-b8319ed95bda`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:07:21,563::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:07:21,564::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:07:21,565::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:07:21,567::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:07:21,568::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:07:21,569::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:07:21,570::task::990::TaskManager.Task::(_decref) Task=`ebe1f778-6b6e-4c57-b4ce-b8319ed95bda`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:07:22,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 23.4 s, 43.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:24,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:25,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0852207 s, 12.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:27,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:27,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0622427 s, 16.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:07:27,803::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:07:27,822::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00050654 s, 983 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:29,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:29,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0619891 s, 16.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:31,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:31,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0682385 s, 15.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:07:31,707::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-13::DEBUG::2014-08-21 10:07:31,708::task::595::TaskManager.Task::(_updateState) Task=`aba24312-634f-4d35-a29c-767458c49e27`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:07:31,709::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:07:31,710::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:07:31,710::task::1185::TaskManager.Task::(prepare) Task=`aba24312-634f-4d35-a29c-767458c49e27`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:07:31,710::task::595::TaskManager.Task::(_updateState) Task=`aba24312-634f-4d35-a29c-767458c49e27`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:07:31,710::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:07:31,710::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:07:31,711::task::990::TaskManager.Task::(_decref) Task=`aba24312-634f-4d35-a29c-767458c49e27`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:07:31,715::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 10:07:31,715::task::595::TaskManager.Task::(_updateState) Task=`de3d91ea-69fd-4eaa-b181-610f9f8c96c1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:07:31,715::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:07:31,716::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c2e7e4d4-6462-488b-84a5-2f0d45596e90`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:07:31,716::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:07:31,717::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:07:31,717::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c2e7e4d4-6462-488b-84a5-2f0d45596e90`::Granted request
>Thread-34::DEBUG::2014-08-21 10:07:31,717::task::827::TaskManager.Task::(resourceAcquired) Task=`de3d91ea-69fd-4eaa-b181-610f9f8c96c1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:07:31,718::task::990::TaskManager.Task::(_decref) Task=`de3d91ea-69fd-4eaa-b181-610f9f8c96c1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:07:31,722::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:07:31,722::task::1185::TaskManager.Task::(prepare) Task=`de3d91ea-69fd-4eaa-b181-610f9f8c96c1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:07:31,722::task::595::TaskManager.Task::(_updateState) Task=`de3d91ea-69fd-4eaa-b181-610f9f8c96c1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:07:31,722::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:07:31,723::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:07:31,723::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:07:31,723::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:07:31,723::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:07:31,723::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:07:31,724::task::990::TaskManager.Task::(_decref) Task=`de3d91ea-69fd-4eaa-b181-610f9f8c96c1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:07:33,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:33,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.056231 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:35,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:35,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0940374 s, 10.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:07:36,775::task::595::TaskManager.Task::(_updateState) Task=`e9c2f576-f6da-4b50-8e5d-52121c3cc65c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:07:36,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:07:36,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050654', 'lastCheck': '8.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:07:36,777::task::1185::TaskManager.Task::(prepare) Task=`e9c2f576-f6da-4b50-8e5d-52121c3cc65c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050654', 'lastCheck': '8.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:07:36,777::task::595::TaskManager.Task::(_updateState) Task=`e9c2f576-f6da-4b50-8e5d-52121c3cc65c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:07:36,777::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:07:36,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:07:36,778::task::990::TaskManager.Task::(_decref) Task=`e9c2f576-f6da-4b50-8e5d-52121c3cc65c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:07:37,846::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:07:37,866::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0019364 s, 257 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:38,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:38,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0671308 s, 15.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:40,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:40,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0728567 s, 14.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:07:41,749::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-13::DEBUG::2014-08-21 10:07:41,751::task::595::TaskManager.Task::(_updateState) Task=`00693540-f358-4c08-aeed-5efeae52c063`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:07:41,752::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:07:41,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:07:41,753::task::1185::TaskManager.Task::(prepare) Task=`00693540-f358-4c08-aeed-5efeae52c063`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:07:41,753::task::595::TaskManager.Task::(_updateState) Task=`00693540-f358-4c08-aeed-5efeae52c063`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:07:41,753::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:07:41,754::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:07:41,754::task::990::TaskManager.Task::(_decref) Task=`00693540-f358-4c08-aeed-5efeae52c063`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:07:41,762::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 10:07:41,763::task::595::TaskManager.Task::(_updateState) Task=`15689130-3c40-42a2-aea3-0cb3491b3df1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:07:41,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:07:41,764::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`207fb087-0665-4e9a-9d89-a1426e3aaec0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:07:41,765::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:07:41,765::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:07:41,766::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`207fb087-0665-4e9a-9d89-a1426e3aaec0`::Granted request
>Thread-34::DEBUG::2014-08-21 10:07:41,766::task::827::TaskManager.Task::(resourceAcquired) Task=`15689130-3c40-42a2-aea3-0cb3491b3df1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:07:41,766::task::990::TaskManager.Task::(_decref) Task=`15689130-3c40-42a2-aea3-0cb3491b3df1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:07:41,772::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:07:41,773::task::1185::TaskManager.Task::(prepare) Task=`15689130-3c40-42a2-aea3-0cb3491b3df1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:07:41,774::task::595::TaskManager.Task::(_updateState) Task=`15689130-3c40-42a2-aea3-0cb3491b3df1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:07:41,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:07:41,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:07:41,775::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:07:41,775::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:07:41,775::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:07:41,776::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:07:41,776::task::990::TaskManager.Task::(_decref) Task=`15689130-3c40-42a2-aea3-0cb3491b3df1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:07:42,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:42,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.156241 s, 6.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:44,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:44,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.248644 s, 4.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:46,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:47,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0680375 s, 15.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:07:47,891::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:07:47,925::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00103724 s, 480 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:49,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:49,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0862624 s, 11.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:51,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:07:51,880::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-13::DEBUG::2014-08-21 10:07:51,882::task::595::TaskManager.Task::(_updateState) Task=`8550cfb9-3f22-44b0-9cd9-dbb04a6dfec8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:07:51,884::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:07:51,988::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:07:51,989::task::1185::TaskManager.Task::(prepare) Task=`8550cfb9-3f22-44b0-9cd9-dbb04a6dfec8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:07:51,989::task::595::TaskManager.Task::(_updateState) Task=`8550cfb9-3f22-44b0-9cd9-dbb04a6dfec8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:07:52,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:07:52,093::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:07:52,100::task::990::TaskManager.Task::(_decref) Task=`8550cfb9-3f22-44b0-9cd9-dbb04a6dfec8`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:07:52,214::task::595::TaskManager.Task::(_updateState) Task=`7de892a6-e631-43fd-82ba-1a8fe69a54fa`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:07:52,218::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:07:52,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103724', 'lastCheck': '4.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:07:52,245::task::1185::TaskManager.Task::(prepare) Task=`7de892a6-e631-43fd-82ba-1a8fe69a54fa`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103724', 'lastCheck': '4.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:07:52,247::task::595::TaskManager.Task::(_updateState) Task=`7de892a6-e631-43fd-82ba-1a8fe69a54fa`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:07:52,248::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:07:52,249::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:07:52,249::task::990::TaskManager.Task::(_decref) Task=`7de892a6-e631-43fd-82ba-1a8fe69a54fa`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:07:52,750::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-34::DEBUG::2014-08-21 10:07:52,782::task::595::TaskManager.Task::(_updateState) Task=`103a7594-35c8-4c3a-bafe-a545c8982360`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:07:52,807::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:07:52,811::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15e481e7-ccbf-486f-bd85-de4d83ecc348`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:07:52,812::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:07:53,084::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:07:53,085::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15e481e7-ccbf-486f-bd85-de4d83ecc348`::Granted request
>Thread-34::DEBUG::2014-08-21 10:07:53,116::task::827::TaskManager.Task::(resourceAcquired) Task=`103a7594-35c8-4c3a-bafe-a545c8982360`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:07:53,117::task::990::TaskManager.Task::(_decref) Task=`103a7594-35c8-4c3a-bafe-a545c8982360`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:07:53,269::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:07:53,271::task::1185::TaskManager.Task::(prepare) Task=`103a7594-35c8-4c3a-bafe-a545c8982360`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:07:53,272::task::595::TaskManager.Task::(_updateState) Task=`103a7594-35c8-4c3a-bafe-a545c8982360`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:07:53,272::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:07:53,273::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:07:53,274::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:07:53,276::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:07:53,292::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:07:53,292::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:07:53,293::task::990::TaskManager.Task::(_decref) Task=`103a7594-35c8-4c3a-bafe-a545c8982360`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:07:53,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.416114 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:55,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:07:55,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0865107 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:07:57,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:07:58,086::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:07:59,432::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:07:59,842::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:08:00,018::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:08:00,067::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:08:00,069::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:08:00,070::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 10:08:00,183::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:08:00,199::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000502379 s, 991 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:00,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.34063 s, 437 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:02,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:02,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.061026 s, 16.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:08:03,388::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-26::DEBUG::2014-08-21 10:08:03,389::task::595::TaskManager.Task::(_updateState) Task=`933022b8-62a0-4bd8-9741-56e15e112aef`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:08:03,390::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:08:03,391::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:03,391::task::1185::TaskManager.Task::(prepare) Task=`933022b8-62a0-4bd8-9741-56e15e112aef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:03,391::task::595::TaskManager.Task::(_updateState) Task=`933022b8-62a0-4bd8-9741-56e15e112aef`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:08:03,392::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:08:03,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:08:03,392::task::990::TaskManager.Task::(_decref) Task=`933022b8-62a0-4bd8-9741-56e15e112aef`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:08:03,400::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 10:08:03,401::task::595::TaskManager.Task::(_updateState) Task=`fbf8cfc9-a3a9-4cf7-b7fe-49b579b6ae66`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:08:03,402::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:08:03,403::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8ce9fda8-6752-48f6-b80a-42ff6b82bf2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:08:03,403::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:08:03,404::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:08:03,404::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8ce9fda8-6752-48f6-b80a-42ff6b82bf2e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:08:03,406::task::827::TaskManager.Task::(resourceAcquired) Task=`fbf8cfc9-a3a9-4cf7-b7fe-49b579b6ae66`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:08:03,406::task::990::TaskManager.Task::(_decref) Task=`fbf8cfc9-a3a9-4cf7-b7fe-49b579b6ae66`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:08:03,412::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:03,413::task::1185::TaskManager.Task::(prepare) Task=`fbf8cfc9-a3a9-4cf7-b7fe-49b579b6ae66`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:03,413::task::595::TaskManager.Task::(_updateState) Task=`fbf8cfc9-a3a9-4cf7-b7fe-49b579b6ae66`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:08:03,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:08:03,414::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:08:03,415::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:08:03,415::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:08:03,416::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:08:03,416::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:08:03,417::task::990::TaskManager.Task::(_decref) Task=`fbf8cfc9-a3a9-4cf7-b7fe-49b579b6ae66`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:08:04,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:04,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137434 s, 7.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:06,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:07,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.132355 s, 7.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:08:09,003::task::595::TaskManager.Task::(_updateState) Task=`b2d0a8ae-d60e-4544-8ea3-843b070c5e18`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:08:09,003::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:08:09,004::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502379', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:08:09,004::task::1185::TaskManager.Task::(prepare) Task=`b2d0a8ae-d60e-4544-8ea3-843b070c5e18`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502379', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:08:09,004::task::595::TaskManager.Task::(_updateState) Task=`b2d0a8ae-d60e-4544-8ea3-843b070c5e18`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:08:09,004::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:08:09,004::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:08:09,005::task::990::TaskManager.Task::(_decref) Task=`b2d0a8ae-d60e-4544-8ea3-843b070c5e18`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:08:09,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:09,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0844677 s, 12.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:08:10,454::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:08:10,791::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00653862 s, 76.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:11,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:08:14,283::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-26::DEBUG::2014-08-21 10:08:14,303::task::595::TaskManager.Task::(_updateState) Task=`d225048c-61bb-47e9-bc22-377c54324833`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:08:14,312::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:08:14,312::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:14,313::task::1185::TaskManager.Task::(prepare) Task=`d225048c-61bb-47e9-bc22-377c54324833`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:14,313::task::595::TaskManager.Task::(_updateState) Task=`d225048c-61bb-47e9-bc22-377c54324833`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:08:14,313::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:08:14,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:08:14,314::task::990::TaskManager.Task::(_decref) Task=`d225048c-61bb-47e9-bc22-377c54324833`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:08:14,331::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-34::DEBUG::2014-08-21 10:08:14,332::task::595::TaskManager.Task::(_updateState) Task=`538864a6-4f77-427e-a030-c6fd4cb24251`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:08:14,340::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:08:14,341::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bb2ca4d8-d918-4f40-9cad-fb3bae1e1e49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:08:14,342::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:08:14,342::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:08:14,342::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bb2ca4d8-d918-4f40-9cad-fb3bae1e1e49`::Granted request
>Thread-34::DEBUG::2014-08-21 10:08:14,343::task::827::TaskManager.Task::(resourceAcquired) Task=`538864a6-4f77-427e-a030-c6fd4cb24251`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:08:14,343::task::990::TaskManager.Task::(_decref) Task=`538864a6-4f77-427e-a030-c6fd4cb24251`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:08:14,348::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:14,349::task::1185::TaskManager.Task::(prepare) Task=`538864a6-4f77-427e-a030-c6fd4cb24251`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:14,350::task::595::TaskManager.Task::(_updateState) Task=`538864a6-4f77-427e-a030-c6fd4cb24251`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:08:14,351::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:08:14,351::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:08:14,384::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:08:14,384::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:08:14,385::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:08:14,385::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:08:14,386::task::990::TaskManager.Task::(_decref) Task=`538864a6-4f77-427e-a030-c6fd4cb24251`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:08:14,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.40929 s, 425 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:16,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:18,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.963 s, 522 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:20,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:21,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.322857 s, 3.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:23,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:08:24,405::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:08:24,545::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-26::DEBUG::2014-08-21 10:08:24,584::task::595::TaskManager.Task::(_updateState) Task=`048bd4af-8b70-4438-85ea-88025b90a184`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:08:24,615::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:08:24,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:24,646::task::1185::TaskManager.Task::(prepare) Task=`048bd4af-8b70-4438-85ea-88025b90a184`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:24,657::task::595::TaskManager.Task::(_updateState) Task=`048bd4af-8b70-4438-85ea-88025b90a184`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 10:08:24,659::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00148718 s, 335 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:08:24,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:08:24,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:08:24,693::task::990::TaskManager.Task::(_decref) Task=`048bd4af-8b70-4438-85ea-88025b90a184`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:08:24,711::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-34::DEBUG::2014-08-21 10:08:24,715::task::595::TaskManager.Task::(_updateState) Task=`3384b8e4-7b40-4a62-a699-0a3e7853aa8d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:08:24,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:08:24,723::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`283aa5da-5a4a-4774-a85d-90cf49b8a070`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:08:24,723::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:08:24,724::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:08:24,725::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`283aa5da-5a4a-4774-a85d-90cf49b8a070`::Granted request
>Thread-34::DEBUG::2014-08-21 10:08:24,726::task::827::TaskManager.Task::(resourceAcquired) Task=`3384b8e4-7b40-4a62-a699-0a3e7853aa8d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:08:24,727::task::990::TaskManager.Task::(_decref) Task=`3384b8e4-7b40-4a62-a699-0a3e7853aa8d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:08:24,734::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:24,734::task::1185::TaskManager.Task::(prepare) Task=`3384b8e4-7b40-4a62-a699-0a3e7853aa8d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:24,735::task::595::TaskManager.Task::(_updateState) Task=`3384b8e4-7b40-4a62-a699-0a3e7853aa8d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:08:24,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:08:24,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:08:24,737::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:08:24,738::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:08:24,739::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:08:24,739::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:08:24,740::task::990::TaskManager.Task::(_decref) Task=`3384b8e4-7b40-4a62-a699-0a3e7853aa8d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:08:24,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.5629 s, 655 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:08:25,070::task::595::TaskManager.Task::(_updateState) Task=`ddf4bcc1-0006-47da-83bc-aeeb39df8301`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:08:25,071::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:08:25,071::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00148718', 'lastCheck': '0.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:08:25,071::task::1185::TaskManager.Task::(prepare) Task=`ddf4bcc1-0006-47da-83bc-aeeb39df8301`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00148718', 'lastCheck': '0.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:08:25,071::task::595::TaskManager.Task::(_updateState) Task=`ddf4bcc1-0006-47da-83bc-aeeb39df8301`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:08:25,072::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:08:25,072::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:08:25,072::task::990::TaskManager.Task::(_decref) Task=`ddf4bcc1-0006-47da-83bc-aeeb39df8301`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:08:26,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:27,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.208853 s, 4.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:29,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:30,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.791221 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:32,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:32,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.54191 s, 1.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:08:34,722::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:08:34,771::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-15::DEBUG::2014-08-21 10:08:34,778::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000705276 s, 706 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:08:34,781::task::595::TaskManager.Task::(_updateState) Task=`028228c4-9904-44d5-a3fe-acbe02fbe5b1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:08:34,788::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:08:34,793::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:34,799::task::1185::TaskManager.Task::(prepare) Task=`028228c4-9904-44d5-a3fe-acbe02fbe5b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:34,800::task::595::TaskManager.Task::(_updateState) Task=`028228c4-9904-44d5-a3fe-acbe02fbe5b1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:08:34,810::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:08:34,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:08:34,836::task::990::TaskManager.Task::(_decref) Task=`028228c4-9904-44d5-a3fe-acbe02fbe5b1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:08:34,907::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Dummy-33::DEBUG::2014-08-21 10:08:34,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:08:34,935::task::595::TaskManager.Task::(_updateState) Task=`a21d2589-acd3-43a1-b27a-9a235dc16678`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:08:34,956::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:08:34,968::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eefb42da-f312-4c9c-8556-333591f40196`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:08:34,970::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:08:34,973::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:08:34,975::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eefb42da-f312-4c9c-8556-333591f40196`::Granted request
>Thread-34::DEBUG::2014-08-21 10:08:34,976::task::827::TaskManager.Task::(resourceAcquired) Task=`a21d2589-acd3-43a1-b27a-9a235dc16678`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:08:34,977::task::990::TaskManager.Task::(_decref) Task=`a21d2589-acd3-43a1-b27a-9a235dc16678`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:08:34,999::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:35,000::task::1185::TaskManager.Task::(prepare) Task=`a21d2589-acd3-43a1-b27a-9a235dc16678`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:35,000::task::595::TaskManager.Task::(_updateState) Task=`a21d2589-acd3-43a1-b27a-9a235dc16678`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:08:35,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:08:35,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:08:35,005::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:08:35,007::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:08:35,009::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:08:35,010::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:08:35,015::task::990::TaskManager.Task::(_decref) Task=`a21d2589-acd3-43a1-b27a-9a235dc16678`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:08:35,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.24929 s, 4.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:37,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:37,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0697598 s, 14.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:08:40,433::task::595::TaskManager.Task::(_updateState) Task=`a8ad858b-f614-4b2f-98af-5519e34cf651`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:08:40,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:08:40,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705276', 'lastCheck': '5.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:08:40,435::task::1185::TaskManager.Task::(prepare) Task=`a8ad858b-f614-4b2f-98af-5519e34cf651`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705276', 'lastCheck': '5.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:08:40,435::task::595::TaskManager.Task::(_updateState) Task=`a8ad858b-f614-4b2f-98af-5519e34cf651`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:08:40,435::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:08:40,435::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:08:40,436::task::990::TaskManager.Task::(_decref) Task=`a8ad858b-f614-4b2f-98af-5519e34cf651`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:08:40,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:40,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0850369 s, 12.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:42,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:42,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0701321 s, 14.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:44,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:08:45,123::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-26::DEBUG::2014-08-21 10:08:45,124::task::595::TaskManager.Task::(_updateState) Task=`193e98f0-4fbd-4b51-9439-fd824b3de87c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:08:45,125::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:08:45,125::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:45,126::task::1185::TaskManager.Task::(prepare) Task=`193e98f0-4fbd-4b51-9439-fd824b3de87c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:08:45,126::task::595::TaskManager.Task::(_updateState) Task=`193e98f0-4fbd-4b51-9439-fd824b3de87c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:08:45,126::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:08:45,126::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:08:45,127::task::990::TaskManager.Task::(_decref) Task=`193e98f0-4fbd-4b51-9439-fd824b3de87c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:08:45,169::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 10:08:45,170::task::595::TaskManager.Task::(_updateState) Task=`bf50a1f3-6600-49d1-982f-73ba5c81c971`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:08:45,171::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:08:45,172::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`60404de6-77a2-471e-b061-7b2eaff181af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:08:45,172::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:08:45,173::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:08:45,173::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`60404de6-77a2-471e-b061-7b2eaff181af`::Granted request
>Thread-34::DEBUG::2014-08-21 10:08:45,174::task::827::TaskManager.Task::(resourceAcquired) Task=`bf50a1f3-6600-49d1-982f-73ba5c81c971`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:08:45,174::task::990::TaskManager.Task::(_decref) Task=`bf50a1f3-6600-49d1-982f-73ba5c81c971`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:08:45,342::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:45,343::task::1185::TaskManager.Task::(prepare) Task=`bf50a1f3-6600-49d1-982f-73ba5c81c971`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:45,343::task::595::TaskManager.Task::(_updateState) Task=`bf50a1f3-6600-49d1-982f-73ba5c81c971`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:08:45,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:08:45,344::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:08:45,344::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:08:45,345::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:08:45,345::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:08:45,345::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:08:45,345::task::990::TaskManager.Task::(_decref) Task=`bf50a1f3-6600-49d1-982f-73ba5c81c971`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:08:46,982::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:08:47,892::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0065301 s, 76.3 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:48,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.19729 s, 320 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:50,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:08:50,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.069282 s, 14.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:56,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:08:56,542::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-13::DEBUG::2014-08-21 10:08:56,554::task::595::TaskManager.Task::(_updateState) Task=`29fce4ca-ec68-46e0-9c3c-93c474b0ab9a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:08:56,563::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:08:56,576::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:08:56,582::task::1185::TaskManager.Task::(prepare) Task=`29fce4ca-ec68-46e0-9c3c-93c474b0ab9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:08:56,586::task::595::TaskManager.Task::(_updateState) Task=`29fce4ca-ec68-46e0-9c3c-93c474b0ab9a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:08:56,593::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:08:56,598::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:08:56,605::task::990::TaskManager.Task::(_decref) Task=`29fce4ca-ec68-46e0-9c3c-93c474b0ab9a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:08:56,687::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-34::DEBUG::2014-08-21 10:08:56,695::task::595::TaskManager.Task::(_updateState) Task=`b0aab491-0a6b-45a5-9335-25b5473ddb22`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:08:56,699::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:08:56,737::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9b17bc6a-8bcb-4ae5-80a0-54175dd537db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:08:56,738::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:08:56,740::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:08:56,742::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9b17bc6a-8bcb-4ae5-80a0-54175dd537db`::Granted request
>Thread-34::DEBUG::2014-08-21 10:08:56,745::task::827::TaskManager.Task::(resourceAcquired) Task=`b0aab491-0a6b-45a5-9335-25b5473ddb22`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:08:56,747::task::990::TaskManager.Task::(_decref) Task=`b0aab491-0a6b-45a5-9335-25b5473ddb22`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:08:56,807::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:56,811::task::1185::TaskManager.Task::(prepare) Task=`b0aab491-0a6b-45a5-9335-25b5473ddb22`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:08:56,813::task::595::TaskManager.Task::(_updateState) Task=`b0aab491-0a6b-45a5-9335-25b5473ddb22`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:08:56,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:08:56,817::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:08:56,820::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:08:56,822::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:08:56,824::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:08:56,825::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:08:56,828::task::990::TaskManager.Task::(_decref) Task=`b0aab491-0a6b-45a5-9335-25b5473ddb22`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:08:57,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.509793 s, 2.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:08:58,139::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:08:58,160::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000922252 s, 540 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:08:59,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:08:59,631::task::595::TaskManager.Task::(_updateState) Task=`44b85039-e4c9-46e5-a412-f56ef1aafcfa`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:08:59,637::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:08:59,670::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000922252', 'lastCheck': '1.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:08:59,671::task::1185::TaskManager.Task::(prepare) Task=`44b85039-e4c9-46e5-a412-f56ef1aafcfa`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000922252', 'lastCheck': '1.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:08:59,672::task::595::TaskManager.Task::(_updateState) Task=`44b85039-e4c9-46e5-a412-f56ef1aafcfa`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:08:59,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:08:59,688::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:08:59,704::task::990::TaskManager.Task::(_decref) Task=`44b85039-e4c9-46e5-a412-f56ef1aafcfa`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:08:59,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.377847 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:01,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:02,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0566778 s, 18.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:04,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:04,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.611601 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:06,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:09:06,864::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Thread-13::DEBUG::2014-08-21 10:09:06,869::task::595::TaskManager.Task::(_updateState) Task=`cbe382d0-65e9-4c62-8b52-dff039649a02`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:09:06,872::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:09:06,874::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:09:06,877::task::1185::TaskManager.Task::(prepare) Task=`cbe382d0-65e9-4c62-8b52-dff039649a02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:09:06,879::task::595::TaskManager.Task::(_updateState) Task=`cbe382d0-65e9-4c62-8b52-dff039649a02`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:09:06,880::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:09:06,881::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:09:06,882::task::990::TaskManager.Task::(_decref) Task=`cbe382d0-65e9-4c62-8b52-dff039649a02`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:09:06,897::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Thread-34::DEBUG::2014-08-21 10:09:06,900::task::595::TaskManager.Task::(_updateState) Task=`85c82cc6-53ce-4dd4-ab46-605871debfcc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:09:06,904::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:09:06,907::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`35b4cb84-257c-4d34-9268-16d731ccbd2f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:09:06,908::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:09:06,908::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:09:06,910::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`35b4cb84-257c-4d34-9268-16d731ccbd2f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:09:06,940::task::827::TaskManager.Task::(resourceAcquired) Task=`85c82cc6-53ce-4dd4-ab46-605871debfcc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:09:06,940::task::990::TaskManager.Task::(_decref) Task=`85c82cc6-53ce-4dd4-ab46-605871debfcc`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:09:06,972::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:06,973::task::1185::TaskManager.Task::(prepare) Task=`85c82cc6-53ce-4dd4-ab46-605871debfcc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:06,973::task::595::TaskManager.Task::(_updateState) Task=`85c82cc6-53ce-4dd4-ab46-605871debfcc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:09:06,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:09:06,974::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:09:06,982::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:09:06,986::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:09:06,988::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:09:06,991::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:09:06,995::task::990::TaskManager.Task::(_decref) Task=`85c82cc6-53ce-4dd4-ab46-605871debfcc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:09:07,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.450181 s, 2.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:09:08,194::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:09:08,211::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000716036 s, 695 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:09,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:09,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0715799 s, 14.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:11,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:11,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.073478 s, 13.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:13,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:14,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.896292 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:09:14,952::task::595::TaskManager.Task::(_updateState) Task=`d2a3147f-98a7-4243-ae6c-ebbbd54faf1d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:09:14,953::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:09:14,953::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716036', 'lastCheck': '6.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:09:14,953::task::1185::TaskManager.Task::(prepare) Task=`d2a3147f-98a7-4243-ae6c-ebbbd54faf1d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716036', 'lastCheck': '6.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:09:14,954::task::595::TaskManager.Task::(_updateState) Task=`d2a3147f-98a7-4243-ae6c-ebbbd54faf1d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:09:14,954::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:09:14,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:09:14,954::task::990::TaskManager.Task::(_decref) Task=`d2a3147f-98a7-4243-ae6c-ebbbd54faf1d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:09:16,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:09:17,052::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [65f62e0f]
>Thread-13::DEBUG::2014-08-21 10:09:17,055::task::595::TaskManager.Task::(_updateState) Task=`fa952159-9c02-42de-a699-b83e3591f88e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:09:17,056::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:09:17,057::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:09:17,058::task::1185::TaskManager.Task::(prepare) Task=`fa952159-9c02-42de-a699-b83e3591f88e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:09:17,058::task::595::TaskManager.Task::(_updateState) Task=`fa952159-9c02-42de-a699-b83e3591f88e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:09:17,059::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:09:17,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:09:17,060::task::990::TaskManager.Task::(_decref) Task=`fa952159-9c02-42de-a699-b83e3591f88e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:09:17,073::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [65f62e0f]
>Thread-34::DEBUG::2014-08-21 10:09:17,076::task::595::TaskManager.Task::(_updateState) Task=`54494e67-0f6c-4a79-80a8-22c73d9e92f3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:09:17,079::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:09:17,082::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bc8a111a-c833-43f8-ae80-08d3f16ee544`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:09:17,083::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:09:17,086::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:09:17,087::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bc8a111a-c833-43f8-ae80-08d3f16ee544`::Granted request
>Thread-34::DEBUG::2014-08-21 10:09:17,090::task::827::TaskManager.Task::(resourceAcquired) Task=`54494e67-0f6c-4a79-80a8-22c73d9e92f3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:09:17,092::task::990::TaskManager.Task::(_decref) Task=`54494e67-0f6c-4a79-80a8-22c73d9e92f3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:09:17,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:17,124::task::1185::TaskManager.Task::(prepare) Task=`54494e67-0f6c-4a79-80a8-22c73d9e92f3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:17,125::task::595::TaskManager.Task::(_updateState) Task=`54494e67-0f6c-4a79-80a8-22c73d9e92f3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:09:17,126::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:09:17,128::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:09:17,130::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:09:17,132::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:09:17,133::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:09:17,134::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:09:17,136::task::990::TaskManager.Task::(_decref) Task=`54494e67-0f6c-4a79-80a8-22c73d9e92f3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:09:17,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.176175 s, 5.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:09:18,238::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:09:18,284::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00191339 s, 260 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:19,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:21,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.08698 s, 491 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:23,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:23,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101124 s, 10.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:25,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:09:28,233::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-13::DEBUG::2014-08-21 10:09:28,494::task::595::TaskManager.Task::(_updateState) Task=`561270d9-ada6-491c-85be-23a589bc9f1c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:09:28,514::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:09:28,527::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:09:28,537::task::1185::TaskManager.Task::(prepare) Task=`561270d9-ada6-491c-85be-23a589bc9f1c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:09:28,546::task::595::TaskManager.Task::(_updateState) Task=`561270d9-ada6-491c-85be-23a589bc9f1c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:09:28,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:09:28,556::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:09:28,562::task::990::TaskManager.Task::(_decref) Task=`561270d9-ada6-491c-85be-23a589bc9f1c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:09:28,613::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-34::DEBUG::2014-08-21 10:09:28,634::task::595::TaskManager.Task::(_updateState) Task=`e991afbe-1289-4895-9d94-a57e1c1f27d3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:09:28,740::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:09:28,741::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:09:28,865::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d9c81297-3c8b-4ab2-8e1b-8f9e012338bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:09:28,873::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:09:28,891::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:09:28,896::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d9c81297-3c8b-4ab2-8e1b-8f9e012338bf`::Granted request
>Thread-34::DEBUG::2014-08-21 10:09:28,908::task::827::TaskManager.Task::(resourceAcquired) Task=`e991afbe-1289-4895-9d94-a57e1c1f27d3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:09:28,912::task::990::TaskManager.Task::(_decref) Task=`e991afbe-1289-4895-9d94-a57e1c1f27d3`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:09:28,919::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00168575 s, 295 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:09:28,985::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:28,988::task::1185::TaskManager.Task::(prepare) Task=`e991afbe-1289-4895-9d94-a57e1c1f27d3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:28,992::task::595::TaskManager.Task::(_updateState) Task=`e991afbe-1289-4895-9d94-a57e1c1f27d3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:09:28,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:09:29,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:09:29,006::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:09:29,045::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:09:29,047::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:09:29,073::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:09:29,079::task::990::TaskManager.Task::(_decref) Task=`e991afbe-1289-4895-9d94-a57e1c1f27d3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:09:29,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.18859 s, 321 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:31,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:09:31,846::task::595::TaskManager.Task::(_updateState) Task=`b2d8ce07-ace5-49a0-a4ce-4b4276f988c5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:09:31,847::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:09:31,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168575', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:09:32,000::task::1185::TaskManager.Task::(prepare) Task=`b2d8ce07-ace5-49a0-a4ce-4b4276f988c5`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168575', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:09:32,001::task::595::TaskManager.Task::(_updateState) Task=`b2d8ce07-ace5-49a0-a4ce-4b4276f988c5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:09:32,257::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:09:32,257::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:09:32,258::task::990::TaskManager.Task::(_decref) Task=`b2d8ce07-ace5-49a0-a4ce-4b4276f988c5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:09:35,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.27982 s, 312 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:37,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:37,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170182 s, 6.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:09:38,997::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:09:39,048::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00223929 s, 222 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:09:39,184::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-13::DEBUG::2014-08-21 10:09:39,185::task::595::TaskManager.Task::(_updateState) Task=`a21c7f30-f207-4a7c-a176-eb312912b1cc`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:09:39,226::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:09:39,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:09:39,229::task::1185::TaskManager.Task::(prepare) Task=`a21c7f30-f207-4a7c-a176-eb312912b1cc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:09:39,230::task::595::TaskManager.Task::(_updateState) Task=`a21c7f30-f207-4a7c-a176-eb312912b1cc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:09:39,231::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:09:39,231::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:09:39,232::task::990::TaskManager.Task::(_decref) Task=`a21c7f30-f207-4a7c-a176-eb312912b1cc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:09:39,410::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-34::DEBUG::2014-08-21 10:09:39,413::task::595::TaskManager.Task::(_updateState) Task=`99f1d217-4693-4440-953d-a52825935840`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:09:39,413::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:09:39,414::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7b3f12b6-003e-4496-97e5-9bc2c3f0124b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:09:39,414::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:09:39,415::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:09:39,415::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7b3f12b6-003e-4496-97e5-9bc2c3f0124b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:09:39,416::task::827::TaskManager.Task::(resourceAcquired) Task=`99f1d217-4693-4440-953d-a52825935840`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:09:39,416::task::990::TaskManager.Task::(_decref) Task=`99f1d217-4693-4440-953d-a52825935840`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:09:39,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:39,433::task::1185::TaskManager.Task::(prepare) Task=`99f1d217-4693-4440-953d-a52825935840`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:39,434::task::595::TaskManager.Task::(_updateState) Task=`99f1d217-4693-4440-953d-a52825935840`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:09:39,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:09:39,435::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:09:39,435::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:09:39,437::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:09:39,437::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:09:39,437::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:09:39,438::task::990::TaskManager.Task::(_decref) Task=`99f1d217-4693-4440-953d-a52825935840`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:09:39,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:39,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.092719 s, 11.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:41,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:43,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.92795 s, 531 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:45,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:46,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.459674 s, 2.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:09:48,528::task::595::TaskManager.Task::(_updateState) Task=`eaf56603-e999-4b80-8717-f9464dbeb9d1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:09:48,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:09:48,529::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00223929', 'lastCheck': '9.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:09:48,530::task::1185::TaskManager.Task::(prepare) Task=`eaf56603-e999-4b80-8717-f9464dbeb9d1`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00223929', 'lastCheck': '9.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:09:48,530::task::595::TaskManager.Task::(_updateState) Task=`eaf56603-e999-4b80-8717-f9464dbeb9d1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:09:48,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:09:48,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:09:48,531::task::990::TaskManager.Task::(_decref) Task=`eaf56603-e999-4b80-8717-f9464dbeb9d1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:09:48,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:09:51,658::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-13::DEBUG::2014-08-21 10:09:51,895::task::595::TaskManager.Task::(_updateState) Task=`251a5e9c-9d86-413e-91dd-5ac22724f453`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:09:51,896::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:09:52,756::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:09:52,822::task::1185::TaskManager.Task::(prepare) Task=`251a5e9c-9d86-413e-91dd-5ac22724f453`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-15::DEBUG::2014-08-21 10:09:52,878::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:09:52,905::task::595::TaskManager.Task::(_updateState) Task=`251a5e9c-9d86-413e-91dd-5ac22724f453`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:09:53,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:09:53,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:09:53,290::task::990::TaskManager.Task::(_decref) Task=`251a5e9c-9d86-413e-91dd-5ac22724f453`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:09:53,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00132332 s, 376 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:09:53,763::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-34::DEBUG::2014-08-21 10:09:53,765::task::595::TaskManager.Task::(_updateState) Task=`ab6d8490-046e-4711-8c3a-81b170f8b308`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:09:53,769::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:09:53,770::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ddf7b4d-998a-4559-900e-27ec2edf4d0a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:09:53,770::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:09:53,771::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:09:53,772::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ddf7b4d-998a-4559-900e-27ec2edf4d0a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:09:53,772::task::827::TaskManager.Task::(resourceAcquired) Task=`ab6d8490-046e-4711-8c3a-81b170f8b308`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:09:53,773::task::990::TaskManager.Task::(_decref) Task=`ab6d8490-046e-4711-8c3a-81b170f8b308`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:09:53,780::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:53,781::task::1185::TaskManager.Task::(prepare) Task=`ab6d8490-046e-4711-8c3a-81b170f8b308`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:09:53,782::task::595::TaskManager.Task::(_updateState) Task=`ab6d8490-046e-4711-8c3a-81b170f8b308`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:09:53,782::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:09:53,783::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:09:53,784::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:09:53,784::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:09:53,785::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:09:53,785::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:09:53,786::task::990::TaskManager.Task::(_decref) Task=`ab6d8490-046e-4711-8c3a-81b170f8b308`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:09:53,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.78507 s, 368 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:56,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:57,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.37113 s, 747 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:09:59,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:09:59,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137963 s, 7.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:01,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:02,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.132498 s, 7.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:10:03,965::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-13::DEBUG::2014-08-21 10:10:03,966::task::595::TaskManager.Task::(_updateState) Task=`f05b0495-e8b8-4eca-a67b-f2914746b147`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:10:03,967::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:10:03,968::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:10:03,968::task::1185::TaskManager.Task::(prepare) Task=`f05b0495-e8b8-4eca-a67b-f2914746b147`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:10:03,968::task::595::TaskManager.Task::(_updateState) Task=`f05b0495-e8b8-4eca-a67b-f2914746b147`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:10:03,969::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:10:03,969::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:10:03,978::task::990::TaskManager.Task::(_decref) Task=`f05b0495-e8b8-4eca-a67b-f2914746b147`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:10:04,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:10:04,112::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-34::DEBUG::2014-08-21 10:10:04,115::task::595::TaskManager.Task::(_updateState) Task=`056269b8-e7f4-446f-a36a-307a9217c56a`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:10:04,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:10:04,117::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9cc6fefa-984f-410a-bb05-5a4d70bdf085`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:10:04,118::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:10:04,119::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Dummy-33::DEBUG::2014-08-21 10:10:04,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:10:04,209::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000482766 s, 1.0 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:10:04,227::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9cc6fefa-984f-410a-bb05-5a4d70bdf085`::Granted request
>Thread-34::DEBUG::2014-08-21 10:10:04,229::task::827::TaskManager.Task::(resourceAcquired) Task=`056269b8-e7f4-446f-a36a-307a9217c56a`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:10:04,229::task::990::TaskManager.Task::(_decref) Task=`056269b8-e7f4-446f-a36a-307a9217c56a`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:10:04,260::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:10:04,261::task::1185::TaskManager.Task::(prepare) Task=`056269b8-e7f4-446f-a36a-307a9217c56a`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:10:04,261::task::595::TaskManager.Task::(_updateState) Task=`056269b8-e7f4-446f-a36a-307a9217c56a`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:10:04,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:10:04,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:10:04,263::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:10:04,264::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:10:04,264::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:10:04,264::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:10:04,265::task::990::TaskManager.Task::(_decref) Task=`056269b8-e7f4-446f-a36a-307a9217c56a`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:10:04,546::task::595::TaskManager.Task::(_updateState) Task=`2ec4dd07-1f17-46eb-873d-fb7ac444c3e3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:10:04,547::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:10:04,547::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482766', 'lastCheck': '0.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:10:04,548::task::1185::TaskManager.Task::(prepare) Task=`2ec4dd07-1f17-46eb-873d-fb7ac444c3e3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482766', 'lastCheck': '0.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:10:04,549::task::595::TaskManager.Task::(_updateState) Task=`2ec4dd07-1f17-46eb-873d-fb7ac444c3e3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:10:04,549::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:10:04,549::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:10:04,554::task::990::TaskManager.Task::(_decref) Task=`2ec4dd07-1f17-46eb-873d-fb7ac444c3e3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:10:04,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.330247 s, 3.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:06,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:07,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107328 s, 9.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:09,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:09,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.560844 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:11,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:12,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.13063 s, 7.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:14,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:14,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0751106 s, 13.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:10:14,293::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-13::DEBUG::2014-08-21 10:10:14,294::task::595::TaskManager.Task::(_updateState) Task=`5c8fe31f-0dad-49bb-90e0-7b93d18e470b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:10:14,294::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:10:14,295::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:10:14,295::task::1185::TaskManager.Task::(prepare) Task=`5c8fe31f-0dad-49bb-90e0-7b93d18e470b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:10:14,295::task::595::TaskManager.Task::(_updateState) Task=`5c8fe31f-0dad-49bb-90e0-7b93d18e470b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:10:14,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:10:14,296::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:10:14,296::task::990::TaskManager.Task::(_decref) Task=`5c8fe31f-0dad-49bb-90e0-7b93d18e470b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:10:14,301::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-34::DEBUG::2014-08-21 10:10:14,302::task::595::TaskManager.Task::(_updateState) Task=`fe87fcce-c6fc-44bc-a42c-a3ce7f736ed8`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:10:14,302::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:10:14,303::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8dc88e8d-8a2b-4cc0-811d-cae91869f403`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:10:14,303::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:10:14,303::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:10:14,304::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8dc88e8d-8a2b-4cc0-811d-cae91869f403`::Granted request
>Thread-34::DEBUG::2014-08-21 10:10:14,304::task::827::TaskManager.Task::(resourceAcquired) Task=`fe87fcce-c6fc-44bc-a42c-a3ce7f736ed8`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:10:14,304::task::990::TaskManager.Task::(_decref) Task=`fe87fcce-c6fc-44bc-a42c-a3ce7f736ed8`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:10:14,309::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:10:14,309::task::1185::TaskManager.Task::(prepare) Task=`fe87fcce-c6fc-44bc-a42c-a3ce7f736ed8`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:10:14,310::task::595::TaskManager.Task::(_updateState) Task=`fe87fcce-c6fc-44bc-a42c-a3ce7f736ed8`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:10:14,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:10:14,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:10:14,311::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:10:14,312::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:10:14,312::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:10:14,312::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:10:14,313::task::990::TaskManager.Task::(_decref) Task=`fe87fcce-c6fc-44bc-a42c-a3ce7f736ed8`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:10:14,463::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:10:14,683::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00119665 s, 416 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:16,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:16,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170474 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:18,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:18,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0653289 s, 15.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:10:19,906::task::595::TaskManager.Task::(_updateState) Task=`ebd43271-37c7-49f6-b71e-25165eb4dc2a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:10:19,908::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:10:19,909::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00119665', 'lastCheck': '5.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:10:19,912::task::1185::TaskManager.Task::(prepare) Task=`ebd43271-37c7-49f6-b71e-25165eb4dc2a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00119665', 'lastCheck': '5.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:10:19,914::task::595::TaskManager.Task::(_updateState) Task=`ebd43271-37c7-49f6-b71e-25165eb4dc2a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:10:19,915::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:10:19,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:10:19,917::task::990::TaskManager.Task::(_decref) Task=`ebd43271-37c7-49f6-b71e-25165eb4dc2a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:10:20,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:20,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0740738 s, 13.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:24,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:10:24,553::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-26::DEBUG::2014-08-21 10:10:25,485::task::595::TaskManager.Task::(_updateState) Task=`218d07c3-aca9-45e2-b62a-546a4f7144fd`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:10:25,736::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:10:25,737::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:10:25,761::task::1185::TaskManager.Task::(prepare) Task=`218d07c3-aca9-45e2-b62a-546a4f7144fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:10:25,762::task::595::TaskManager.Task::(_updateState) Task=`218d07c3-aca9-45e2-b62a-546a4f7144fd`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:10:25,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:10:25,782::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:10:25,860::task::990::TaskManager.Task::(_decref) Task=`218d07c3-aca9-45e2-b62a-546a4f7144fd`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:10:26,978::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-34::DEBUG::2014-08-21 10:10:27,429::task::595::TaskManager.Task::(_updateState) Task=`e92a7c16-8dec-426e-bd37-5f9375d27918`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:10:27,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:10:27,629::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2ffbb781-5cf4-4a71-84d3-39a462278fa7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:10:27,630::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:10:27,637::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:10:27,637::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2ffbb781-5cf4-4a71-84d3-39a462278fa7`::Granted request
>Thread-34::DEBUG::2014-08-21 10:10:27,638::task::827::TaskManager.Task::(resourceAcquired) Task=`e92a7c16-8dec-426e-bd37-5f9375d27918`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:10:27,638::task::990::TaskManager.Task::(_decref) Task=`e92a7c16-8dec-426e-bd37-5f9375d27918`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:10:27,689::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:10:27,693::task::1185::TaskManager.Task::(prepare) Task=`e92a7c16-8dec-426e-bd37-5f9375d27918`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:10:27,698::task::595::TaskManager.Task::(_updateState) Task=`e92a7c16-8dec-426e-bd37-5f9375d27918`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:10:27,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:10:27,699::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:10:27,714::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:10:27,725::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:10:27,728::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:10:27,729::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:10:28,052::task::990::TaskManager.Task::(_decref) Task=`e92a7c16-8dec-426e-bd37-5f9375d27918`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:10:29,872::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:10:31,441::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0350238 s, 14.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:32,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.37424 s, 161 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:34,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:35,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.484198 s, 2.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:10:38,141::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-26::DEBUG::2014-08-21 10:10:38,169::task::595::TaskManager.Task::(_updateState) Task=`b8690671-6e8b-45f6-a8bf-87e734ef69fe`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:10:38,170::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:10:38,171::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:10:38,171::task::1185::TaskManager.Task::(prepare) Task=`b8690671-6e8b-45f6-a8bf-87e734ef69fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:10:38,171::task::595::TaskManager.Task::(_updateState) Task=`b8690671-6e8b-45f6-a8bf-87e734ef69fe`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:10:38,172::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:10:38,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:10:38,172::task::990::TaskManager.Task::(_decref) Task=`b8690671-6e8b-45f6-a8bf-87e734ef69fe`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:10:38,282::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-34::DEBUG::2014-08-21 10:10:38,361::task::595::TaskManager.Task::(_updateState) Task=`e0d18c88-2a28-4f8b-bae5-81d5d94c3dd9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:10:38,433::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:10:38,553::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`52c15da5-9d21-4d27-bed8-0ff62cf1d558`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:10:38,554::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:10:38,571::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:10:38,571::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`52c15da5-9d21-4d27-bed8-0ff62cf1d558`::Granted request
>Thread-34::DEBUG::2014-08-21 10:10:38,572::task::827::TaskManager.Task::(resourceAcquired) Task=`e0d18c88-2a28-4f8b-bae5-81d5d94c3dd9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:10:38,634::task::990::TaskManager.Task::(_decref) Task=`e0d18c88-2a28-4f8b-bae5-81d5d94c3dd9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:10:38,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:10:38,696::task::1185::TaskManager.Task::(prepare) Task=`e0d18c88-2a28-4f8b-bae5-81d5d94c3dd9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:10:38,696::task::595::TaskManager.Task::(_updateState) Task=`e0d18c88-2a28-4f8b-bae5-81d5d94c3dd9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:10:38,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:10:38,697::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:10:38,697::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:10:38,698::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:10:38,698::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:10:38,698::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:10:38,698::task::990::TaskManager.Task::(_decref) Task=`e0d18c88-2a28-4f8b-bae5-81d5d94c3dd9`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:10:39,726::task::595::TaskManager.Task::(_updateState) Task=`66cb431e-e60c-455a-a460-647bfdfb04d1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:10:39,727::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:10:39,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0350238', 'lastCheck': '7.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:10:39,737::task::1185::TaskManager.Task::(prepare) Task=`66cb431e-e60c-455a-a460-647bfdfb04d1`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0350238', 'lastCheck': '7.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:10:39,738::task::595::TaskManager.Task::(_updateState) Task=`66cb431e-e60c-455a-a460-647bfdfb04d1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:10:39,749::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:10:39,750::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:10:39,783::task::990::TaskManager.Task::(_decref) Task=`66cb431e-e60c-455a-a460-647bfdfb04d1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:10:39,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:10:43,974::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:10:44,054::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00159799 s, 312 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:44,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.71851 s, 275 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:46,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:10:46,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0662965 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:10:48,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:11:14,819::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-26::DEBUG::2014-08-21 10:11:14,836::task::595::TaskManager.Task::(_updateState) Task=`45b0f782-fc70-48f0-b723-37bf8ed36202`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:11:14,847::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:11:14,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:11:14,864::task::1185::TaskManager.Task::(prepare) Task=`45b0f782-fc70-48f0-b723-37bf8ed36202`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:11:14,867::task::595::TaskManager.Task::(_updateState) Task=`45b0f782-fc70-48f0-b723-37bf8ed36202`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:11:14,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:11:14,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:11:14,878::task::990::TaskManager.Task::(_decref) Task=`45b0f782-fc70-48f0-b723-37bf8ed36202`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:11:14,898::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-34::DEBUG::2014-08-21 10:11:14,903::task::595::TaskManager.Task::(_updateState) Task=`050d7286-19a2-47a5-bbbf-d73013de5ae4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:11:14,908::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:11:14,917::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bf448261-119a-4b5e-a892-70dcee7c2107`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:11:14,919::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:11:14,923::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:11:14,926::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bf448261-119a-4b5e-a892-70dcee7c2107`::Granted request
>Thread-34::DEBUG::2014-08-21 10:11:14,935::task::827::TaskManager.Task::(resourceAcquired) Task=`050d7286-19a2-47a5-bbbf-d73013de5ae4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:11:14,939::task::990::TaskManager.Task::(_decref) Task=`050d7286-19a2-47a5-bbbf-d73013de5ae4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:11:15,294::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:11:15,303::task::1185::TaskManager.Task::(prepare) Task=`050d7286-19a2-47a5-bbbf-d73013de5ae4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:11:15,304::task::595::TaskManager.Task::(_updateState) Task=`050d7286-19a2-47a5-bbbf-d73013de5ae4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:11:15,304::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:11:15,416::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 10:11:15,444::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:11:15,445::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:11:38,229::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:11:38,230::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:11:38,248::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:11:38,249::task::990::TaskManager.Task::(_decref) Task=`050d7286-19a2-47a5-bbbf-d73013de5ae4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:11:38,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.438987 s, 1.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:11:39,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 50.8533 s, 20.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:11:41,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:11:41,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.172805 s, 5.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:11:43,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:11:43,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0842628 s, 12.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:11:47,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:11:47,996::task::595::TaskManager.Task::(_updateState) Task=`76439d71-36fe-4dfc-bff2-8eaa809f39a4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:11:48,001::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:11:48,003::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.438987', 'lastCheck': '8.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:11:48,004::task::1185::TaskManager.Task::(prepare) Task=`76439d71-36fe-4dfc-bff2-8eaa809f39a4`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.438987', 'lastCheck': '8.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:11:48,005::task::595::TaskManager.Task::(_updateState) Task=`76439d71-36fe-4dfc-bff2-8eaa809f39a4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:11:48,006::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:11:48,006::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:11:48,007::task::990::TaskManager.Task::(_decref) Task=`76439d71-36fe-4dfc-bff2-8eaa809f39a4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:11:48,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0757606 s, 13.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:11:48,872::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-26::DEBUG::2014-08-21 10:11:48,873::task::595::TaskManager.Task::(_updateState) Task=`1f4b9c3b-159b-4639-ad85-be9e33712823`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:11:48,874::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:11:48,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:11:48,876::task::1185::TaskManager.Task::(prepare) Task=`1f4b9c3b-159b-4639-ad85-be9e33712823`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:11:48,876::task::595::TaskManager.Task::(_updateState) Task=`1f4b9c3b-159b-4639-ad85-be9e33712823`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:11:48,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:11:48,877::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:11:48,877::task::990::TaskManager.Task::(_decref) Task=`1f4b9c3b-159b-4639-ad85-be9e33712823`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:11:48,926::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-34::DEBUG::2014-08-21 10:11:48,928::task::595::TaskManager.Task::(_updateState) Task=`3bbc15f8-a21a-4202-96dd-c6f6f7053623`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:11:48,928::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:11:48,930::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e3ba7245-a8d0-4722-9c82-b1ee02b5ea0a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:11:48,932::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:11:48,934::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:11:48,935::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e3ba7245-a8d0-4722-9c82-b1ee02b5ea0a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:11:48,952::task::827::TaskManager.Task::(resourceAcquired) Task=`3bbc15f8-a21a-4202-96dd-c6f6f7053623`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:11:48,953::task::990::TaskManager.Task::(_decref) Task=`3bbc15f8-a21a-4202-96dd-c6f6f7053623`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:11:48,969::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:11:48,970::task::1185::TaskManager.Task::(prepare) Task=`3bbc15f8-a21a-4202-96dd-c6f6f7053623`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:11:48,970::task::595::TaskManager.Task::(_updateState) Task=`3bbc15f8-a21a-4202-96dd-c6f6f7053623`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:11:48,971::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:11:48,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:11:48,972::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:11:48,972::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:11:48,972::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:11:48,973::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:11:48,973::task::990::TaskManager.Task::(_decref) Task=`3bbc15f8-a21a-4202-96dd-c6f6f7053623`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:11:49,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:11:49,338::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000880247 s, 566 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:11:50,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:11:52,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.93334 s, 530 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:11:54,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:11:55,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.530722 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:11:57,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:11:59,054::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-13::DEBUG::2014-08-21 10:11:59,056::task::595::TaskManager.Task::(_updateState) Task=`6074549c-ce02-4090-911f-e068329c0152`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:11:59,056::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:11:59,057::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:11:59,057::task::1185::TaskManager.Task::(prepare) Task=`6074549c-ce02-4090-911f-e068329c0152`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:11:59,058::task::595::TaskManager.Task::(_updateState) Task=`6074549c-ce02-4090-911f-e068329c0152`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:11:59,058::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:11:59,058::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:11:59,058::task::990::TaskManager.Task::(_decref) Task=`6074549c-ce02-4090-911f-e068329c0152`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:12:00,150::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 10:12:00,152::task::595::TaskManager.Task::(_updateState) Task=`3adbfe2d-1e5a-48e0-9df4-09c4abf74d60`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:12:00,153::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:12:00,155::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ff2baeb0-3d71-4c33-b456-9fc92ce04e9f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:12:00,155::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 10:12:00,201::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:12:00,201::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:12:00,226::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ff2baeb0-3d71-4c33-b456-9fc92ce04e9f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:12:00,252::task::827::TaskManager.Task::(resourceAcquired) Task=`3adbfe2d-1e5a-48e0-9df4-09c4abf74d60`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:12:00,258::task::990::TaskManager.Task::(_decref) Task=`3adbfe2d-1e5a-48e0-9df4-09c4abf74d60`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:12:00,295::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000706208 s, 705 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:12:00,343::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:00,348::task::1185::TaskManager.Task::(prepare) Task=`3adbfe2d-1e5a-48e0-9df4-09c4abf74d60`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:00,351::task::595::TaskManager.Task::(_updateState) Task=`3adbfe2d-1e5a-48e0-9df4-09c4abf74d60`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:12:00,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:12:00,361::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:12:00,368::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:12:00,374::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:12:00,375::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:12:00,376::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:12:00,378::task::990::TaskManager.Task::(_decref) Task=`3adbfe2d-1e5a-48e0-9df4-09c4abf74d60`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:12:00,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.1498 s, 476 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:02,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:02,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0579058 s, 17.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:04,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:05,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.15662 s, 6.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:12:05,311::task::595::TaskManager.Task::(_updateState) Task=`409ce179-0d02-43a5-b0ad-a878b478dcfe`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:12:05,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:12:05,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706208', 'lastCheck': '4.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:12:05,312::task::1185::TaskManager.Task::(prepare) Task=`409ce179-0d02-43a5-b0ad-a878b478dcfe`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706208', 'lastCheck': '4.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:12:05,313::task::595::TaskManager.Task::(_updateState) Task=`409ce179-0d02-43a5-b0ad-a878b478dcfe`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:12:05,313::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:12:05,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:12:05,313::task::990::TaskManager.Task::(_decref) Task=`409ce179-0d02-43a5-b0ad-a878b478dcfe`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:12:07,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:07,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.212434 s, 4.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:09,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:12:13,966::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-26::DEBUG::2014-08-21 10:12:13,987::task::595::TaskManager.Task::(_updateState) Task=`a425ad96-aa5f-4512-8c30-0fc461ab0b5d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:12:13,990::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:12:13,992::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:12:14,018::task::1185::TaskManager.Task::(prepare) Task=`a425ad96-aa5f-4512-8c30-0fc461ab0b5d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:12:14,032::task::595::TaskManager.Task::(_updateState) Task=`a425ad96-aa5f-4512-8c30-0fc461ab0b5d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:12:14,045::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:12:14,051::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:12:14,062::task::990::TaskManager.Task::(_decref) Task=`a425ad96-aa5f-4512-8c30-0fc461ab0b5d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:12:14,096::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 10:12:14,106::task::595::TaskManager.Task::(_updateState) Task=`284da49f-4bfa-4d17-b0e8-153bbcbe0357`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:12:14,114::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:12:14,130::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5f20341c-2019-4636-9775-7d4e434b384e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:12:14,136::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:12:14,145::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:12:14,151::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5f20341c-2019-4636-9775-7d4e434b384e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:12:14,159::task::827::TaskManager.Task::(resourceAcquired) Task=`284da49f-4bfa-4d17-b0e8-153bbcbe0357`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:12:14,162::task::990::TaskManager.Task::(_decref) Task=`284da49f-4bfa-4d17-b0e8-153bbcbe0357`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:12:14,217::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897309184', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:14,218::task::1185::TaskManager.Task::(prepare) Task=`284da49f-4bfa-4d17-b0e8-153bbcbe0357`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897309184', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:14,220::task::595::TaskManager.Task::(_updateState) Task=`284da49f-4bfa-4d17-b0e8-153bbcbe0357`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:12:14,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:12:14,224::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:12:14,227::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:12:14,232::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:12:14,237::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:12:14,241::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:12:14,246::task::990::TaskManager.Task::(_decref) Task=`284da49f-4bfa-4d17-b0e8-153bbcbe0357`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:12:14,278::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:12:14,318::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000615786 s, 809 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:14,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.98316 s, 205 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:16,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:16,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0496653 s, 20.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:18,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:19,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.292147 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:21,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:21,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.608116 s, 1.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:12:23,061::task::595::TaskManager.Task::(_updateState) Task=`6511e0e8-e717-4754-bbdf-3b8ba91224a3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:12:23,062::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:12:23,062::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615786', 'lastCheck': '8.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:12:23,063::task::1185::TaskManager.Task::(prepare) Task=`6511e0e8-e717-4754-bbdf-3b8ba91224a3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615786', 'lastCheck': '8.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:12:23,063::task::595::TaskManager.Task::(_updateState) Task=`6511e0e8-e717-4754-bbdf-3b8ba91224a3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:12:23,063::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:12:23,063::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:12:23,063::task::990::TaskManager.Task::(_decref) Task=`6511e0e8-e717-4754-bbdf-3b8ba91224a3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:12:24,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:24,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869879 s, 11.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:12:24,290::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2d92e2f2]
>Thread-26::DEBUG::2014-08-21 10:12:24,291::task::595::TaskManager.Task::(_updateState) Task=`044d4646-6db5-485a-b414-e0d7fe95ab41`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:12:24,292::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:12:24,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:12:24,293::task::1185::TaskManager.Task::(prepare) Task=`044d4646-6db5-485a-b414-e0d7fe95ab41`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:12:24,293::task::595::TaskManager.Task::(_updateState) Task=`044d4646-6db5-485a-b414-e0d7fe95ab41`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:12:24,294::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:12:24,294::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:12:24,295::task::990::TaskManager.Task::(_decref) Task=`044d4646-6db5-485a-b414-e0d7fe95ab41`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:12:24,304::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2d92e2f2]
>Thread-34::DEBUG::2014-08-21 10:12:24,305::task::595::TaskManager.Task::(_updateState) Task=`87c36239-05b9-43ad-973b-356ff1fb058a`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:12:24,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:12:24,307::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c51e653d-cec2-4fd8-8817-8a15f88557fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:12:24,307::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:12:24,307::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:12:24,308::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c51e653d-cec2-4fd8-8817-8a15f88557fb`::Granted request
>Thread-34::DEBUG::2014-08-21 10:12:24,311::task::827::TaskManager.Task::(resourceAcquired) Task=`87c36239-05b9-43ad-973b-356ff1fb058a`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:12:24,311::task::990::TaskManager.Task::(_decref) Task=`87c36239-05b9-43ad-973b-356ff1fb058a`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:12:24,319::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:24,320::task::1185::TaskManager.Task::(prepare) Task=`87c36239-05b9-43ad-973b-356ff1fb058a`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:24,321::task::595::TaskManager.Task::(_updateState) Task=`87c36239-05b9-43ad-973b-356ff1fb058a`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:12:24,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:12:24,321::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:12:24,322::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:12:24,322::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:12:24,322::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:12:24,323::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:12:24,323::task::990::TaskManager.Task::(_decref) Task=`87c36239-05b9-43ad-973b-356ff1fb058a`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:12:24,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:12:24,375::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000612257 s, 813 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:26,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:26,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.466504 s, 2.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:28,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:28,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.076647 s, 13.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:30,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:12:34,402::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-13::DEBUG::2014-08-21 10:12:35,230::task::595::TaskManager.Task::(_updateState) Task=`bb11dec6-96ca-456e-ab08-6e00335e9755`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:12:35,636::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:12:35,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:12:35,803::task::1185::TaskManager.Task::(prepare) Task=`bb11dec6-96ca-456e-ab08-6e00335e9755`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:12:35,810::task::595::TaskManager.Task::(_updateState) Task=`bb11dec6-96ca-456e-ab08-6e00335e9755`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:12:35,827::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:12:35,833::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 10:12:36,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:12:36,409::task::990::TaskManager.Task::(_decref) Task=`bb11dec6-96ca-456e-ab08-6e00335e9755`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:12:37,233::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000472647 s, 1.1 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:12:38,438::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-34::DEBUG::2014-08-21 10:12:38,443::task::595::TaskManager.Task::(_updateState) Task=`3352ca7b-2b7a-4499-b96b-b638c0bbdf62`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:12:38,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:12:38,447::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`476ad454-ad08-49dc-81ea-5e4d464b135e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:12:38,448::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:12:38,450::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:12:38,451::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`476ad454-ad08-49dc-81ea-5e4d464b135e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:12:38,455::task::827::TaskManager.Task::(resourceAcquired) Task=`3352ca7b-2b7a-4499-b96b-b638c0bbdf62`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:12:38,457::task::990::TaskManager.Task::(_decref) Task=`3352ca7b-2b7a-4499-b96b-b638c0bbdf62`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:12:38,508::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:38,510::task::1185::TaskManager.Task::(prepare) Task=`3352ca7b-2b7a-4499-b96b-b638c0bbdf62`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:38,511::task::595::TaskManager.Task::(_updateState) Task=`3352ca7b-2b7a-4499-b96b-b638c0bbdf62`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:12:38,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:12:38,513::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:12:38,515::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:12:38,517::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:12:38,518::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:12:38,519::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:12:38,521::task::990::TaskManager.Task::(_decref) Task=`3352ca7b-2b7a-4499-b96b-b638c0bbdf62`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:12:38,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.38665 s, 139 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:40,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:40,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0713345 s, 14.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:12:41,762::task::595::TaskManager.Task::(_updateState) Task=`842eba71-878a-4b04-98f8-ea0c82d42cfb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:12:41,762::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:12:41,763::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472647', 'lastCheck': '3.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:12:41,763::task::1185::TaskManager.Task::(prepare) Task=`842eba71-878a-4b04-98f8-ea0c82d42cfb`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472647', 'lastCheck': '3.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:12:41,763::task::595::TaskManager.Task::(_updateState) Task=`842eba71-878a-4b04-98f8-ea0c82d42cfb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:12:41,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:12:41,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:12:41,764::task::990::TaskManager.Task::(_decref) Task=`842eba71-878a-4b04-98f8-ea0c82d42cfb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:12:42,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:42,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0868542 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:44,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:46,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.74707 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:48,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:12:48,966::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-26::DEBUG::2014-08-21 10:12:48,967::task::595::TaskManager.Task::(_updateState) Task=`75257528-c9d0-4678-ac23-c0aca830c407`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:12:48,968::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:12:48,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:12:48,969::task::1185::TaskManager.Task::(prepare) Task=`75257528-c9d0-4678-ac23-c0aca830c407`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:12:48,970::task::595::TaskManager.Task::(_updateState) Task=`75257528-c9d0-4678-ac23-c0aca830c407`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:12:48,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:12:48,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:12:48,972::task::990::TaskManager.Task::(_decref) Task=`75257528-c9d0-4678-ac23-c0aca830c407`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:12:48,986::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-34::DEBUG::2014-08-21 10:12:48,990::task::595::TaskManager.Task::(_updateState) Task=`936e4229-3fc5-4000-8889-b1373172dd6c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:12:48,993::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:12:49,012::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`49cd000b-681c-4d65-89d1-1742aeffe5ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:12:49,014::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:12:49,018::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:12:49,020::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`49cd000b-681c-4d65-89d1-1742aeffe5ac`::Granted request
>Thread-15::DEBUG::2014-08-21 10:12:49,040::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:12:49,059::task::827::TaskManager.Task::(resourceAcquired) Task=`936e4229-3fc5-4000-8889-b1373172dd6c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:12:49,059::task::990::TaskManager.Task::(_decref) Task=`936e4229-3fc5-4000-8889-b1373172dd6c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:12:49,064::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:49,064::task::1185::TaskManager.Task::(prepare) Task=`936e4229-3fc5-4000-8889-b1373172dd6c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:12:49,065::task::595::TaskManager.Task::(_updateState) Task=`936e4229-3fc5-4000-8889-b1373172dd6c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:12:49,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:12:49,065::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:12:49,065::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:12:49,066::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:12:49,066::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:12:49,066::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:12:49,067::task::990::TaskManager.Task::(_decref) Task=`936e4229-3fc5-4000-8889-b1373172dd6c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:12:49,185::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.064835 s, 7.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:49,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.882695 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:51,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:51,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0566707 s, 18.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:53,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:12:53,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104652 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:12:55,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:12:58,651::task::595::TaskManager.Task::(_updateState) Task=`0c52ed42-de88-4650-887a-c3eb72045d5a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:12:58,688::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:12:58,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.064835', 'lastCheck': '9.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:12:58,701::task::1185::TaskManager.Task::(prepare) Task=`0c52ed42-de88-4650-887a-c3eb72045d5a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.064835', 'lastCheck': '9.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:12:59,616::task::595::TaskManager.Task::(_updateState) Task=`0c52ed42-de88-4650-887a-c3eb72045d5a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:12:59,703::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-15::DEBUG::2014-08-21 10:12:59,995::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-26::DEBUG::2014-08-21 10:13:00,021::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:13:01,412::task::990::TaskManager.Task::(_decref) Task=`0c52ed42-de88-4650-887a-c3eb72045d5a`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:13:00,051::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-13::DEBUG::2014-08-21 10:13:01,634::task::595::TaskManager.Task::(_updateState) Task=`a8762134-6741-45dc-806b-73b2c947c5f4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:13:01,763::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:13:02,280::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:13:03,986::task::1185::TaskManager.Task::(prepare) Task=`a8762134-6741-45dc-806b-73b2c947c5f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:13:06,044::task::595::TaskManager.Task::(_updateState) Task=`a8762134-6741-45dc-806b-73b2c947c5f4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:13:06,050::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:13:06,050::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:13:06,051::task::990::TaskManager.Task::(_decref) Task=`a8762134-6741-45dc-806b-73b2c947c5f4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:13:07,779::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-34::DEBUG::2014-08-21 10:13:08,018::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-15::DEBUG::2014-08-21 10:13:08,431::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-34::DEBUG::2014-08-21 10:13:08,056::task::595::TaskManager.Task::(_updateState) Task=`219b76d0-2dfd-49ca-98ee-80cb8cfed9d6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:13:09,639::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:13:09,782::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b3d9cc4f-615d-460e-a9b0-eb1608ca619e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:13:10,624::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:13:10,723::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:13:10,736::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b3d9cc4f-615d-460e-a9b0-eb1608ca619e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:13:10,793::task::827::TaskManager.Task::(resourceAcquired) Task=`219b76d0-2dfd-49ca-98ee-80cb8cfed9d6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-15::DEBUG::2014-08-21 10:13:10,806::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-34::DEBUG::2014-08-21 10:13:11,090::task::990::TaskManager.Task::(_decref) Task=`219b76d0-2dfd-49ca-98ee-80cb8cfed9d6`::ref 1 aborting False
>Dummy-33::DEBUG::2014-08-21 10:13:11,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.25006 s, 315 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:13:11,467::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:13:11,480::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:13:11,481::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-34::INFO::2014-08-21 10:13:11,803::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:13:11,804::task::1185::TaskManager.Task::(prepare) Task=`219b76d0-2dfd-49ca-98ee-80cb8cfed9d6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:13:11,804::task::595::TaskManager.Task::(_updateState) Task=`219b76d0-2dfd-49ca-98ee-80cb8cfed9d6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:13:11,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:13:11,805::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:13:11,837::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:13:11,852::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:13:12,173::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:13:12,206::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:13:12,264::task::990::TaskManager.Task::(_decref) Task=`219b76d0-2dfd-49ca-98ee-80cb8cfed9d6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:13:33,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:13:45,231::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-26::DEBUG::2014-08-21 10:13:45,793::task::595::TaskManager.Task::(_updateState) Task=`7db0dac1-d38e-4386-8b29-2ddf26d893ad`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:13:45,804::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:13:45,808::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:13:45,809::task::1185::TaskManager.Task::(prepare) Task=`7db0dac1-d38e-4386-8b29-2ddf26d893ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:13:45,811::task::595::TaskManager.Task::(_updateState) Task=`7db0dac1-d38e-4386-8b29-2ddf26d893ad`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:13:45,812::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:13:45,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:13:45,843::task::990::TaskManager.Task::(_decref) Task=`7db0dac1-d38e-4386-8b29-2ddf26d893ad`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:13:45,862::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-34::DEBUG::2014-08-21 10:13:45,879::task::595::TaskManager.Task::(_updateState) Task=`c1a66152-2d71-4307-a236-0fc92fddf4ee`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:13:45,891::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:13:45,913::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`471e4ba4-1d96-4456-99a4-c23ff9cdf73f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:13:45,927::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:13:45,938::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:13:45,942::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`471e4ba4-1d96-4456-99a4-c23ff9cdf73f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:13:45,953::task::827::TaskManager.Task::(resourceAcquired) Task=`c1a66152-2d71-4307-a236-0fc92fddf4ee`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:13:45,957::task::990::TaskManager.Task::(_decref) Task=`c1a66152-2d71-4307-a236-0fc92fddf4ee`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:13:45,976::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:13:46,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00465482 s, 107 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:13:46,086::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:13:46,091::task::1185::TaskManager.Task::(prepare) Task=`c1a66152-2d71-4307-a236-0fc92fddf4ee`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:13:46,095::task::595::TaskManager.Task::(_updateState) Task=`c1a66152-2d71-4307-a236-0fc92fddf4ee`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:13:46,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:13:46,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:13:46,114::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:13:46,123::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:13:46,129::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:13:46,133::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:13:46,141::task::990::TaskManager.Task::(_decref) Task=`c1a66152-2d71-4307-a236-0fc92fddf4ee`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:13:46,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.0824 s, 946 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:13:48,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:13:48,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0735741 s, 13.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:13:50,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:13:54,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.417182 s, 2.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:13:56,258::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-26::DEBUG::2014-08-21 10:13:56,259::task::595::TaskManager.Task::(_updateState) Task=`ef914d34-ed95-4786-946c-96d278c7de15`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:13:56,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:13:56,276::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:13:56,533::task::1185::TaskManager.Task::(prepare) Task=`ef914d34-ed95-4786-946c-96d278c7de15`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:13:56,537::task::595::TaskManager.Task::(_updateState) Task=`ef914d34-ed95-4786-946c-96d278c7de15`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:13:56,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:13:56,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:13:56,594::task::990::TaskManager.Task::(_decref) Task=`ef914d34-ed95-4786-946c-96d278c7de15`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:13:56,905::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:13:57,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:13:58,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0207893 s, 24.0 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:14:01,338::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-13::DEBUG::2014-08-21 10:14:01,366::task::595::TaskManager.Task::(_updateState) Task=`d6be8bf3-9a56-4a80-89b5-bf84b1898df0`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:14:01,677::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:14:01,678::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00465482', 'lastCheck': '15.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:14:01,678::task::1185::TaskManager.Task::(prepare) Task=`d6be8bf3-9a56-4a80-89b5-bf84b1898df0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00465482', 'lastCheck': '15.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:14:01,679::task::595::TaskManager.Task::(_updateState) Task=`d6be8bf3-9a56-4a80-89b5-bf84b1898df0`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:14:01,679::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:14:01,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:14:01,680::task::990::TaskManager.Task::(_decref) Task=`d6be8bf3-9a56-4a80-89b5-bf84b1898df0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:14:02,387::task::595::TaskManager.Task::(_updateState) Task=`7fde4332-a7e6-48de-a079-35d47a3850f0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:14:02,388::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:14:02,390::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`36327df3-cd93-4df5-9786-65a4ea66f11d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:14:02,563::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:14:02,664::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:14:02,665::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`36327df3-cd93-4df5-9786-65a4ea66f11d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:14:02,666::task::827::TaskManager.Task::(resourceAcquired) Task=`7fde4332-a7e6-48de-a079-35d47a3850f0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:14:02,667::task::990::TaskManager.Task::(_decref) Task=`7fde4332-a7e6-48de-a079-35d47a3850f0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:14:03,015::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:03,016::task::1185::TaskManager.Task::(prepare) Task=`7fde4332-a7e6-48de-a079-35d47a3850f0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:03,017::task::595::TaskManager.Task::(_updateState) Task=`7fde4332-a7e6-48de-a079-35d47a3850f0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:14:03,017::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:14:03,022::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:14:03,036::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:14:03,042::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:14:03,043::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:14:03,043::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:14:03,044::task::990::TaskManager.Task::(_decref) Task=`7fde4332-a7e6-48de-a079-35d47a3850f0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:14:03,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.19846 s, 197 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:05,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:06,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.504001 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:08,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:08,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0684809 s, 15.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:10,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:10,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.144561 s, 7.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:12,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:14:13,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:14:13,180::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00739314 s, 67.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:13,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.259332 s, 3.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:14:13,254::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-13::DEBUG::2014-08-21 10:14:13,257::task::595::TaskManager.Task::(_updateState) Task=`c31f6ce8-0b5a-418a-ac16-f7998364ebca`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:14:13,258::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:14:13,259::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:14:13,259::task::1185::TaskManager.Task::(prepare) Task=`c31f6ce8-0b5a-418a-ac16-f7998364ebca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:14:13,259::task::595::TaskManager.Task::(_updateState) Task=`c31f6ce8-0b5a-418a-ac16-f7998364ebca`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:14:13,259::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:14:13,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:14:13,260::task::990::TaskManager.Task::(_decref) Task=`c31f6ce8-0b5a-418a-ac16-f7998364ebca`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:14:13,282::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-34::DEBUG::2014-08-21 10:14:13,283::task::595::TaskManager.Task::(_updateState) Task=`f5bd897b-0ffc-46a5-9c2c-379f538bbb67`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:14:13,283::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:14:13,285::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cb78c8e6-07da-472f-9715-cf1d2e8004bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:14:13,285::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:14:13,286::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:14:13,287::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cb78c8e6-07da-472f-9715-cf1d2e8004bb`::Granted request
>Thread-34::DEBUG::2014-08-21 10:14:13,289::task::827::TaskManager.Task::(resourceAcquired) Task=`f5bd897b-0ffc-46a5-9c2c-379f538bbb67`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:14:13,290::task::990::TaskManager.Task::(_decref) Task=`f5bd897b-0ffc-46a5-9c2c-379f538bbb67`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:14:13,298::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897112576', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:13,298::task::1185::TaskManager.Task::(prepare) Task=`f5bd897b-0ffc-46a5-9c2c-379f538bbb67`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897112576', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:13,299::task::595::TaskManager.Task::(_updateState) Task=`f5bd897b-0ffc-46a5-9c2c-379f538bbb67`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:14:13,316::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:14:13,317::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:14:13,317::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:14:13,318::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:14:13,318::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:14:13,319::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:14:13,319::task::990::TaskManager.Task::(_decref) Task=`f5bd897b-0ffc-46a5-9c2c-379f538bbb67`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:14:15,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:15,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0892516 s, 11.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:17,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:17,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125805 s, 8.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:14:18,196::task::595::TaskManager.Task::(_updateState) Task=`689eea39-0104-44f6-bc2a-60ac378fc1ff`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:14:18,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:14:18,198::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00739314', 'lastCheck': '5.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:14:18,198::task::1185::TaskManager.Task::(prepare) Task=`689eea39-0104-44f6-bc2a-60ac378fc1ff`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00739314', 'lastCheck': '5.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:14:18,198::task::595::TaskManager.Task::(_updateState) Task=`689eea39-0104-44f6-bc2a-60ac378fc1ff`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:14:18,198::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:14:18,198::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:14:18,199::task::990::TaskManager.Task::(_decref) Task=`689eea39-0104-44f6-bc2a-60ac378fc1ff`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:14:19,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:23,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.01532 s, 1.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:14:23,250::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:14:23,317::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00503581 s, 98.9 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:14:23,420::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-26::DEBUG::2014-08-21 10:14:23,422::task::595::TaskManager.Task::(_updateState) Task=`2c04111d-9fa0-49bd-9641-7077847eaed1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:14:23,423::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:14:23,424::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:14:23,424::task::1185::TaskManager.Task::(prepare) Task=`2c04111d-9fa0-49bd-9641-7077847eaed1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:14:23,424::task::595::TaskManager.Task::(_updateState) Task=`2c04111d-9fa0-49bd-9641-7077847eaed1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:14:23,425::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:14:23,425::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:14:23,426::task::990::TaskManager.Task::(_decref) Task=`2c04111d-9fa0-49bd-9641-7077847eaed1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:14:23,491::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 10:14:23,493::task::595::TaskManager.Task::(_updateState) Task=`bb9193c6-4bf7-4a5b-9f43-60c54fb28097`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:14:23,542::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:14:23,544::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`70906c35-a4b8-425c-86f2-bd7822632843`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:14:23,609::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:14:23,746::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:14:23,747::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`70906c35-a4b8-425c-86f2-bd7822632843`::Granted request
>Thread-34::DEBUG::2014-08-21 10:14:23,748::task::827::TaskManager.Task::(resourceAcquired) Task=`bb9193c6-4bf7-4a5b-9f43-60c54fb28097`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:14:23,749::task::990::TaskManager.Task::(_decref) Task=`bb9193c6-4bf7-4a5b-9f43-60c54fb28097`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:14:23,758::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897112576', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:23,758::task::1185::TaskManager.Task::(prepare) Task=`bb9193c6-4bf7-4a5b-9f43-60c54fb28097`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897112576', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:23,758::task::595::TaskManager.Task::(_updateState) Task=`bb9193c6-4bf7-4a5b-9f43-60c54fb28097`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:14:23,759::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:14:23,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:14:23,760::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:14:23,760::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:14:23,761::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:14:23,761::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:14:23,761::task::990::TaskManager.Task::(_decref) Task=`bb9193c6-4bf7-4a5b-9f43-60c54fb28097`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:14:25,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:26,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.410508 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:28,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:28,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0688975 s, 14.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:30,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:33,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.345635 s, 3.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:14:33,362::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:14:33,377::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000525011 s, 949 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:14:33,948::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-13::DEBUG::2014-08-21 10:14:33,949::task::595::TaskManager.Task::(_updateState) Task=`bde93e25-3598-4c9f-a219-0f69d2d25f33`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:14:33,949::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:14:33,950::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:14:33,950::task::1185::TaskManager.Task::(prepare) Task=`bde93e25-3598-4c9f-a219-0f69d2d25f33`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:14:33,950::task::595::TaskManager.Task::(_updateState) Task=`bde93e25-3598-4c9f-a219-0f69d2d25f33`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:14:33,950::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:14:33,951::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:14:33,951::task::990::TaskManager.Task::(_decref) Task=`bde93e25-3598-4c9f-a219-0f69d2d25f33`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:14:33,956::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-34::DEBUG::2014-08-21 10:14:33,957::task::595::TaskManager.Task::(_updateState) Task=`2dc5247f-70d8-49d6-aa03-cdb4e8a165dc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:14:33,958::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:14:33,959::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9367e633-65b5-46a6-93e1-eb1f9635b790`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:14:33,959::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:14:33,959::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:14:33,959::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9367e633-65b5-46a6-93e1-eb1f9635b790`::Granted request
>Thread-34::DEBUG::2014-08-21 10:14:33,960::task::827::TaskManager.Task::(resourceAcquired) Task=`2dc5247f-70d8-49d6-aa03-cdb4e8a165dc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:14:33,960::task::990::TaskManager.Task::(_decref) Task=`2dc5247f-70d8-49d6-aa03-cdb4e8a165dc`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:14:33,966::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:33,966::task::1185::TaskManager.Task::(prepare) Task=`2dc5247f-70d8-49d6-aa03-cdb4e8a165dc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:33,966::task::595::TaskManager.Task::(_updateState) Task=`2dc5247f-70d8-49d6-aa03-cdb4e8a165dc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:14:33,967::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:14:33,967::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:14:33,967::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:14:33,967::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:14:33,968::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:14:33,968::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:14:33,968::task::990::TaskManager.Task::(_decref) Task=`2dc5247f-70d8-49d6-aa03-cdb4e8a165dc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:14:35,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:35,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0577223 s, 17.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:37,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:37,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.599146 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:40,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:42,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.41514 s, 724 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:14:43,399::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:14:43,414::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000905741 s, 550 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:14:43,991::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-13::DEBUG::2014-08-21 10:14:44,010::task::595::TaskManager.Task::(_updateState) Task=`c4944924-8bda-4ce6-b339-037dc90f9709`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:14:44,010::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:14:44,011::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:14:44,011::task::1185::TaskManager.Task::(prepare) Task=`c4944924-8bda-4ce6-b339-037dc90f9709`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:14:44,012::task::595::TaskManager.Task::(_updateState) Task=`c4944924-8bda-4ce6-b339-037dc90f9709`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:14:44,012::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:14:44,012::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:14:44,013::task::990::TaskManager.Task::(_decref) Task=`c4944924-8bda-4ce6-b339-037dc90f9709`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:14:44,391::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Dummy-33::DEBUG::2014-08-21 10:14:44,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:14:44,536::task::595::TaskManager.Task::(_updateState) Task=`132b9bc0-ba2c-49dc-88a1-f7bec4793711`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:14:44,537::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:14:44,538::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5e861838-e1ff-468c-86e9-c5674a22dec1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:14:44,539::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:14:44,539::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:14:44,540::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5e861838-e1ff-468c-86e9-c5674a22dec1`::Granted request
>Thread-34::DEBUG::2014-08-21 10:14:44,554::task::827::TaskManager.Task::(resourceAcquired) Task=`132b9bc0-ba2c-49dc-88a1-f7bec4793711`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:14:44,565::task::990::TaskManager.Task::(_decref) Task=`132b9bc0-ba2c-49dc-88a1-f7bec4793711`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:14:44,604::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897309184', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:44,604::task::1185::TaskManager.Task::(prepare) Task=`132b9bc0-ba2c-49dc-88a1-f7bec4793711`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897309184', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:44,605::task::595::TaskManager.Task::(_updateState) Task=`132b9bc0-ba2c-49dc-88a1-f7bec4793711`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:14:44,605::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:14:44,606::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:14:44,606::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:14:44,607::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:14:44,607::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:14:44,607::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:14:44,608::task::990::TaskManager.Task::(_decref) Task=`132b9bc0-ba2c-49dc-88a1-f7bec4793711`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:14:44,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178897 s, 5.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:14:45,411::task::595::TaskManager.Task::(_updateState) Task=`bc466657-2a06-4423-8f63-eee49f52b700`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:14:45,412::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:14:45,412::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000905741', 'lastCheck': '2.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:14:45,412::task::1185::TaskManager.Task::(prepare) Task=`bc466657-2a06-4423-8f63-eee49f52b700`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000905741', 'lastCheck': '2.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:14:45,413::task::595::TaskManager.Task::(_updateState) Task=`bc466657-2a06-4423-8f63-eee49f52b700`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:14:45,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:14:45,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:14:45,413::task::990::TaskManager.Task::(_decref) Task=`bc466657-2a06-4423-8f63-eee49f52b700`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:14:46,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:14:53,789::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:14:53,927::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000768002 s, 648 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:54,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.72554 s, 152 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:14:54,637::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-13::DEBUG::2014-08-21 10:14:54,639::task::595::TaskManager.Task::(_updateState) Task=`d15de282-1bf1-4009-8336-239e251af00f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:14:54,639::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:14:54,640::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:14:54,640::task::1185::TaskManager.Task::(prepare) Task=`d15de282-1bf1-4009-8336-239e251af00f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:14:54,640::task::595::TaskManager.Task::(_updateState) Task=`d15de282-1bf1-4009-8336-239e251af00f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:14:54,641::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:14:54,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:14:54,641::task::990::TaskManager.Task::(_decref) Task=`d15de282-1bf1-4009-8336-239e251af00f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:14:54,652::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-34::DEBUG::2014-08-21 10:14:54,653::task::595::TaskManager.Task::(_updateState) Task=`c1f522ba-0317-42eb-8d26-abc44b6ae42c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:14:54,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:14:54,654::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e2f8f471-c373-4fef-8879-b6f0c72b1978`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:14:54,655::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:14:54,655::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:14:54,655::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e2f8f471-c373-4fef-8879-b6f0c72b1978`::Granted request
>Thread-34::DEBUG::2014-08-21 10:14:54,656::task::827::TaskManager.Task::(resourceAcquired) Task=`c1f522ba-0317-42eb-8d26-abc44b6ae42c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:14:54,656::task::990::TaskManager.Task::(_decref) Task=`c1f522ba-0317-42eb-8d26-abc44b6ae42c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:14:54,662::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:54,662::task::1185::TaskManager.Task::(prepare) Task=`c1f522ba-0317-42eb-8d26-abc44b6ae42c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:14:54,663::task::595::TaskManager.Task::(_updateState) Task=`c1f522ba-0317-42eb-8d26-abc44b6ae42c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:14:54,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:14:54,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:14:54,664::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:14:54,665::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:14:54,665::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:14:54,665::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:14:54,666::task::990::TaskManager.Task::(_decref) Task=`c1f522ba-0317-42eb-8d26-abc44b6ae42c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:14:56,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:57,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.373904 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:14:59,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:14:59,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0686579 s, 14.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:01,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:01,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0677176 s, 15.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:15:02,770::task::595::TaskManager.Task::(_updateState) Task=`21a7c514-a8fd-4366-a84a-381608ab61ec`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:15:02,773::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:15:02,773::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000768002', 'lastCheck': '8.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:15:02,774::task::1185::TaskManager.Task::(prepare) Task=`21a7c514-a8fd-4366-a84a-381608ab61ec`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000768002', 'lastCheck': '8.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:15:02,774::task::595::TaskManager.Task::(_updateState) Task=`21a7c514-a8fd-4366-a84a-381608ab61ec`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:15:02,813::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:15:02,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:15:02,814::task::990::TaskManager.Task::(_decref) Task=`21a7c514-a8fd-4366-a84a-381608ab61ec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:03,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:03,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.246572 s, 4.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:15:04,241::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:15:04,263::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00111265 s, 448 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:15:04,680::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-13::DEBUG::2014-08-21 10:15:04,681::task::595::TaskManager.Task::(_updateState) Task=`9cb6ea7b-ddee-463d-b5c4-0ee2ae159400`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:15:04,683::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:15:04,683::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:04,683::task::1185::TaskManager.Task::(prepare) Task=`9cb6ea7b-ddee-463d-b5c4-0ee2ae159400`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:04,684::task::595::TaskManager.Task::(_updateState) Task=`9cb6ea7b-ddee-463d-b5c4-0ee2ae159400`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:15:04,684::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:15:04,684::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:15:04,685::task::990::TaskManager.Task::(_decref) Task=`9cb6ea7b-ddee-463d-b5c4-0ee2ae159400`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:15:04,689::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-34::DEBUG::2014-08-21 10:15:04,690::task::595::TaskManager.Task::(_updateState) Task=`b020a062-1fe4-4e54-8a66-78d4b4acdc81`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:15:04,690::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:15:04,691::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`48544f23-ae92-414a-8a1f-c8854794b487`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:15:04,692::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:15:04,692::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:15:04,693::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`48544f23-ae92-414a-8a1f-c8854794b487`::Granted request
>Thread-34::DEBUG::2014-08-21 10:15:04,693::task::827::TaskManager.Task::(resourceAcquired) Task=`b020a062-1fe4-4e54-8a66-78d4b4acdc81`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:15:04,694::task::990::TaskManager.Task::(_decref) Task=`b020a062-1fe4-4e54-8a66-78d4b4acdc81`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:15:04,701::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896981504', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:04,701::task::1185::TaskManager.Task::(prepare) Task=`b020a062-1fe4-4e54-8a66-78d4b4acdc81`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896981504', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:04,702::task::595::TaskManager.Task::(_updateState) Task=`b020a062-1fe4-4e54-8a66-78d4b4acdc81`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:15:04,702::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:15:04,703::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:15:04,703::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:15:04,704::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:15:04,704::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:15:04,704::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:15:04,705::task::990::TaskManager.Task::(_decref) Task=`b020a062-1fe4-4e54-8a66-78d4b4acdc81`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:05,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:06,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121182 s, 8.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:08,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:08,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0542243 s, 18.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:10,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:10,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0780162 s, 13.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:12,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:12,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0837848 s, 12.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:15:14,302::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:15:14,339::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000586746 s, 849 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:14,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:15:14,758::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-13::DEBUG::2014-08-21 10:15:14,762::task::595::TaskManager.Task::(_updateState) Task=`4c9b402c-ccf2-499b-8ed3-436c8b5a62dc`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:15:14,764::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:15:14,767::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:14,773::task::1185::TaskManager.Task::(prepare) Task=`4c9b402c-ccf2-499b-8ed3-436c8b5a62dc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:14,774::task::595::TaskManager.Task::(_updateState) Task=`4c9b402c-ccf2-499b-8ed3-436c8b5a62dc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:15:14,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:15:14,776::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:15:14,777::task::990::TaskManager.Task::(_decref) Task=`4c9b402c-ccf2-499b-8ed3-436c8b5a62dc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:15:14,787::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 10:15:14,790::task::595::TaskManager.Task::(_updateState) Task=`babad91a-d01e-45d6-8d17-f6fa4f80aa98`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:15:14,792::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:15:14,795::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac834db8-c484-42d9-bcfe-2cc8c9218c2b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:15:14,796::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:15:14,798::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:15:14,799::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac834db8-c484-42d9-bcfe-2cc8c9218c2b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:15:14,802::task::827::TaskManager.Task::(resourceAcquired) Task=`babad91a-d01e-45d6-8d17-f6fa4f80aa98`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:15:14,803::task::990::TaskManager.Task::(_decref) Task=`babad91a-d01e-45d6-8d17-f6fa4f80aa98`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:15:14,825::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:14,827::task::1185::TaskManager.Task::(prepare) Task=`babad91a-d01e-45d6-8d17-f6fa4f80aa98`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:14,828::task::595::TaskManager.Task::(_updateState) Task=`babad91a-d01e-45d6-8d17-f6fa4f80aa98`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:15:14,829::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:15:14,830::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:15:14,832::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:15:14,833::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:15:14,834::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:15:14,834::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:15:14,836::task::990::TaskManager.Task::(_decref) Task=`babad91a-d01e-45d6-8d17-f6fa4f80aa98`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:14,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0701556 s, 14.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:16,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:15:18,208::task::595::TaskManager.Task::(_updateState) Task=`9916fd8b-d0a5-4505-b79c-fe2d08df1950`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:15:18,222::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:15:18,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586746', 'lastCheck': '3.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:15:18,341::task::1185::TaskManager.Task::(prepare) Task=`9916fd8b-d0a5-4505-b79c-fe2d08df1950`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586746', 'lastCheck': '3.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:15:18,360::task::595::TaskManager.Task::(_updateState) Task=`9916fd8b-d0a5-4505-b79c-fe2d08df1950`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:15:18,383::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:15:18,400::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:15:18,428::task::990::TaskManager.Task::(_decref) Task=`9916fd8b-d0a5-4505-b79c-fe2d08df1950`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:18,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.922355 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:20,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:20,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0680469 s, 15.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:22,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:23,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.339112 s, 3.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:15:25,182::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:15:25,215::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-26::DEBUG::2014-08-21 10:15:25,217::task::595::TaskManager.Task::(_updateState) Task=`26aa6576-3f80-4c77-ab73-f5005344e7a9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:15:25,220::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:15:25,221::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:15:25,221::task::1185::TaskManager.Task::(prepare) Task=`26aa6576-3f80-4c77-ab73-f5005344e7a9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:15:25,221::task::595::TaskManager.Task::(_updateState) Task=`26aa6576-3f80-4c77-ab73-f5005344e7a9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:15:25,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:15:25,222::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:15:25,222::task::990::TaskManager.Task::(_decref) Task=`26aa6576-3f80-4c77-ab73-f5005344e7a9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:25,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:15:26,395::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00906553 s, 54.9 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:15:26,501::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 10:15:26,545::task::595::TaskManager.Task::(_updateState) Task=`7fedee49-8abb-4595-bd7e-6524341e87ea`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:15:26,671::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:15:27,208::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f20c7710-89cb-4862-9a79-4ac4642a8d6a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:15:27,209::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:15:27,226::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:15:27,320::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f20c7710-89cb-4862-9a79-4ac4642a8d6a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:15:27,480::task::827::TaskManager.Task::(resourceAcquired) Task=`7fedee49-8abb-4595-bd7e-6524341e87ea`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:15:27,505::task::990::TaskManager.Task::(_decref) Task=`7fedee49-8abb-4595-bd7e-6524341e87ea`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:15:27,734::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:27,735::task::1185::TaskManager.Task::(prepare) Task=`7fedee49-8abb-4595-bd7e-6524341e87ea`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:27,736::task::595::TaskManager.Task::(_updateState) Task=`7fedee49-8abb-4595-bd7e-6524341e87ea`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:15:27,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:15:27,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:15:27,737::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:15:27,737::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:15:27,738::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:15:27,738::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:15:27,739::task::990::TaskManager.Task::(_decref) Task=`7fedee49-8abb-4595-bd7e-6524341e87ea`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:30,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.35922 s, 305 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:32,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:32,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090273 s, 11.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:35,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:35,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125315 s, 8.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:15:36,190::task::595::TaskManager.Task::(_updateState) Task=`873ef189-42f4-44d7-8535-d48ad28c7765`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:15:36,191::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:15:36,192::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00906553', 'lastCheck': '8.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:15:36,192::task::1185::TaskManager.Task::(prepare) Task=`873ef189-42f4-44d7-8535-d48ad28c7765`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00906553', 'lastCheck': '8.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:15:36,192::task::595::TaskManager.Task::(_updateState) Task=`873ef189-42f4-44d7-8535-d48ad28c7765`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:15:36,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:15:36,193::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:15:36,193::task::990::TaskManager.Task::(_decref) Task=`873ef189-42f4-44d7-8535-d48ad28c7765`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:37,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:37,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0749567 s, 13.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:15:37,927::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:15:37,974::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00139877 s, 356 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:15:38,423::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-13::DEBUG::2014-08-21 10:15:38,424::task::595::TaskManager.Task::(_updateState) Task=`40709f1a-d44d-44cc-8a94-3108f936fd93`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:15:38,425::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:15:38,425::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:38,425::task::1185::TaskManager.Task::(prepare) Task=`40709f1a-d44d-44cc-8a94-3108f936fd93`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:38,426::task::595::TaskManager.Task::(_updateState) Task=`40709f1a-d44d-44cc-8a94-3108f936fd93`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:15:38,426::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:15:38,426::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:15:38,426::task::990::TaskManager.Task::(_decref) Task=`40709f1a-d44d-44cc-8a94-3108f936fd93`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:15:38,431::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-34::DEBUG::2014-08-21 10:15:38,432::task::595::TaskManager.Task::(_updateState) Task=`28704e28-dc4e-4b00-a139-8b285e050a2c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:15:38,432::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:15:38,433::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dd184ee2-5dd7-42e2-8c7f-add12e92985d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:15:38,434::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:15:38,435::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:15:38,435::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dd184ee2-5dd7-42e2-8c7f-add12e92985d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:15:38,436::task::827::TaskManager.Task::(resourceAcquired) Task=`28704e28-dc4e-4b00-a139-8b285e050a2c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:15:38,436::task::990::TaskManager.Task::(_decref) Task=`28704e28-dc4e-4b00-a139-8b285e050a2c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:15:38,477::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:38,477::task::1185::TaskManager.Task::(prepare) Task=`28704e28-dc4e-4b00-a139-8b285e050a2c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:38,478::task::595::TaskManager.Task::(_updateState) Task=`28704e28-dc4e-4b00-a139-8b285e050a2c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:15:38,478::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:15:38,478::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:15:38,479::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:15:38,479::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:15:38,479::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:15:38,479::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:15:38,480::task::990::TaskManager.Task::(_decref) Task=`28704e28-dc4e-4b00-a139-8b285e050a2c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:39,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:39,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0653799 s, 15.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:41,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:42,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100129 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:44,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:44,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0735223 s, 13.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:46,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:15:48,346::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:15:48,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00347366 s, 143 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:15:48,509::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-13::DEBUG::2014-08-21 10:15:48,510::task::595::TaskManager.Task::(_updateState) Task=`b19e368c-375f-4a8d-8fc3-bef74ee4fdf5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:15:48,511::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:15:48,513::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:48,513::task::1185::TaskManager.Task::(prepare) Task=`b19e368c-375f-4a8d-8fc3-bef74ee4fdf5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:48,514::task::595::TaskManager.Task::(_updateState) Task=`b19e368c-375f-4a8d-8fc3-bef74ee4fdf5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:15:48,514::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:15:48,515::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:15:48,516::task::990::TaskManager.Task::(_decref) Task=`b19e368c-375f-4a8d-8fc3-bef74ee4fdf5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:15:48,522::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-34::DEBUG::2014-08-21 10:15:48,523::task::595::TaskManager.Task::(_updateState) Task=`bcdf3738-b968-418a-90d0-56b17e0f1b10`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:15:48,524::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:15:48,525::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5f072ff1-0156-4d6f-a4b3-52f71fbfb11d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:15:48,525::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:15:48,525::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:15:48,526::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5f072ff1-0156-4d6f-a4b3-52f71fbfb11d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:15:48,526::task::827::TaskManager.Task::(resourceAcquired) Task=`bcdf3738-b968-418a-90d0-56b17e0f1b10`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:15:48,527::task::990::TaskManager.Task::(_decref) Task=`bcdf3738-b968-418a-90d0-56b17e0f1b10`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:15:48,531::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:48,531::task::1185::TaskManager.Task::(prepare) Task=`bcdf3738-b968-418a-90d0-56b17e0f1b10`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:48,532::task::595::TaskManager.Task::(_updateState) Task=`bcdf3738-b968-418a-90d0-56b17e0f1b10`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:15:48,532::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:15:48,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:15:48,533::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:15:48,533::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:15:48,533::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:15:48,534::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:15:48,534::task::990::TaskManager.Task::(_decref) Task=`bcdf3738-b968-418a-90d0-56b17e0f1b10`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:48,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.31781 s, 442 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:50,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:15:51,760::task::595::TaskManager.Task::(_updateState) Task=`c49da17a-e4ef-431b-afe6-fd9a48b7937d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:15:51,762::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:15:51,763::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00347366', 'lastCheck': '2.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:15:51,764::task::1185::TaskManager.Task::(prepare) Task=`c49da17a-e4ef-431b-afe6-fd9a48b7937d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00347366', 'lastCheck': '2.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:15:51,764::task::595::TaskManager.Task::(_updateState) Task=`c49da17a-e4ef-431b-afe6-fd9a48b7937d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:15:51,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:15:51,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:15:51,764::task::990::TaskManager.Task::(_decref) Task=`c49da17a-e4ef-431b-afe6-fd9a48b7937d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:15:52,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.562366 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:54,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:54,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0887345 s, 11.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:56,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:57,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.620049 s, 1.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:15:58,567::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-13::DEBUG::2014-08-21 10:15:58,568::task::595::TaskManager.Task::(_updateState) Task=`2c8c229f-fb2f-4614-9eec-932ed654308f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:15:58,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:15:58,570::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:58,571::task::1185::TaskManager.Task::(prepare) Task=`2c8c229f-fb2f-4614-9eec-932ed654308f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:15:58,571::task::595::TaskManager.Task::(_updateState) Task=`2c8c229f-fb2f-4614-9eec-932ed654308f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:15:58,571::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:15:58,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:15:58,572::task::990::TaskManager.Task::(_decref) Task=`2c8c229f-fb2f-4614-9eec-932ed654308f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:15:58,636::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-34::DEBUG::2014-08-21 10:15:58,637::task::595::TaskManager.Task::(_updateState) Task=`9ac70bee-ae9e-42b2-a775-89ca75fa0afe`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:15:58,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:15:58,638::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a0b3691b-828d-4fef-a14e-88fcdf00fd5d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:15:58,639::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:15:58,639::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:15:58,639::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a0b3691b-828d-4fef-a14e-88fcdf00fd5d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:15:58,640::task::827::TaskManager.Task::(resourceAcquired) Task=`9ac70bee-ae9e-42b2-a775-89ca75fa0afe`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:15:58,640::task::990::TaskManager.Task::(_decref) Task=`9ac70bee-ae9e-42b2-a775-89ca75fa0afe`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:15:58,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:58,648::task::1185::TaskManager.Task::(prepare) Task=`9ac70bee-ae9e-42b2-a775-89ca75fa0afe`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:15:58,648::task::595::TaskManager.Task::(_updateState) Task=`9ac70bee-ae9e-42b2-a775-89ca75fa0afe`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:15:58,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:15:58,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:15:58,649::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:15:58,650::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:15:58,650::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:15:58,650::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:15:58,650::task::990::TaskManager.Task::(_decref) Task=`9ac70bee-ae9e-42b2-a775-89ca75fa0afe`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:15:59,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:15:59,231::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000787013 s, 633 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:15:59,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:15:59,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901066 s, 11.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:01,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:07,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.06805 s, 252 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:16:08,294::task::595::TaskManager.Task::(_updateState) Task=`66408493-551d-4f85-84b4-ef2d67392572`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:16:08,295::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:16:08,295::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787013', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:16:08,295::task::1185::TaskManager.Task::(prepare) Task=`66408493-551d-4f85-84b4-ef2d67392572`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787013', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:16:08,296::task::595::TaskManager.Task::(_updateState) Task=`66408493-551d-4f85-84b4-ef2d67392572`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:16:08,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:16:08,296::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:16:08,297::task::990::TaskManager.Task::(_decref) Task=`66408493-551d-4f85-84b4-ef2d67392572`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:16:08,680::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14a1da75]
>Thread-13::DEBUG::2014-08-21 10:16:08,681::task::595::TaskManager.Task::(_updateState) Task=`71f6ca87-460b-4634-9d31-bf4b4fe91a39`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:16:08,681::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:16:08,682::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:16:08,682::task::1185::TaskManager.Task::(prepare) Task=`71f6ca87-460b-4634-9d31-bf4b4fe91a39`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:16:08,683::task::595::TaskManager.Task::(_updateState) Task=`71f6ca87-460b-4634-9d31-bf4b4fe91a39`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:16:08,683::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:16:08,683::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:16:08,684::task::990::TaskManager.Task::(_decref) Task=`71f6ca87-460b-4634-9d31-bf4b4fe91a39`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:16:08,706::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14a1da75]
>Thread-34::DEBUG::2014-08-21 10:16:08,708::task::595::TaskManager.Task::(_updateState) Task=`d149df2d-4740-4969-97f9-4281f387730e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:16:08,709::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:16:08,710::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`67b86714-2478-4ed8-b476-e0f074848859`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:16:08,711::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:16:08,711::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:16:08,712::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`67b86714-2478-4ed8-b476-e0f074848859`::Granted request
>Thread-34::DEBUG::2014-08-21 10:16:08,713::task::827::TaskManager.Task::(resourceAcquired) Task=`d149df2d-4740-4969-97f9-4281f387730e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:16:08,713::task::990::TaskManager.Task::(_decref) Task=`d149df2d-4740-4969-97f9-4281f387730e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:16:08,735::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:08,735::task::1185::TaskManager.Task::(prepare) Task=`d149df2d-4740-4969-97f9-4281f387730e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:08,736::task::595::TaskManager.Task::(_updateState) Task=`d149df2d-4740-4969-97f9-4281f387730e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:16:08,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:16:08,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:16:08,738::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:16:08,738::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:16:08,738::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:16:08,739::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:16:08,739::task::990::TaskManager.Task::(_decref) Task=`d149df2d-4740-4969-97f9-4281f387730e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:16:09,253::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:16:09,269::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000465632 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:09,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:10,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.122541 s, 8.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:12,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:12,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0565584 s, 18.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:15,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:15,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.149808 s, 6.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:17,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:17,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0717738 s, 14.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:16:18,778::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-13::DEBUG::2014-08-21 10:16:18,779::task::595::TaskManager.Task::(_updateState) Task=`d2ccec4b-6a27-4e74-a5aa-94786f06e064`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:16:18,780::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:16:18,780::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:16:18,781::task::1185::TaskManager.Task::(prepare) Task=`d2ccec4b-6a27-4e74-a5aa-94786f06e064`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:16:18,781::task::595::TaskManager.Task::(_updateState) Task=`d2ccec4b-6a27-4e74-a5aa-94786f06e064`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:16:18,781::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:16:18,782::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:16:18,782::task::990::TaskManager.Task::(_decref) Task=`d2ccec4b-6a27-4e74-a5aa-94786f06e064`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:16:18,793::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-34::DEBUG::2014-08-21 10:16:18,794::task::595::TaskManager.Task::(_updateState) Task=`6912f2e1-11d9-49fb-9fd0-f78089a0351d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:16:18,795::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:16:18,795::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d7b01779-6e59-4a56-8f0f-0e6feea06091`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:16:18,796::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:16:18,797::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:16:18,797::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d7b01779-6e59-4a56-8f0f-0e6feea06091`::Granted request
>Thread-34::DEBUG::2014-08-21 10:16:18,802::task::827::TaskManager.Task::(resourceAcquired) Task=`6912f2e1-11d9-49fb-9fd0-f78089a0351d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:16:18,803::task::990::TaskManager.Task::(_decref) Task=`6912f2e1-11d9-49fb-9fd0-f78089a0351d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:16:18,881::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:18,882::task::1185::TaskManager.Task::(prepare) Task=`6912f2e1-11d9-49fb-9fd0-f78089a0351d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:18,882::task::595::TaskManager.Task::(_updateState) Task=`6912f2e1-11d9-49fb-9fd0-f78089a0351d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:16:18,906::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:16:18,906::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:16:18,918::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:16:18,919::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:16:18,920::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:16:18,920::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:16:18,921::task::990::TaskManager.Task::(_decref) Task=`6912f2e1-11d9-49fb-9fd0-f78089a0351d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:16:23,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:16:24,604::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:16:24,649::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000515204 s, 967 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:24,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.34594 s, 761 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:26,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:27,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.195201 s, 5.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:16:27,547::task::595::TaskManager.Task::(_updateState) Task=`40bfd9a6-5e77-49ee-9f13-eb3544d1df2b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:16:27,553::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:16:27,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515204', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:16:27,561::task::1185::TaskManager.Task::(prepare) Task=`40bfd9a6-5e77-49ee-9f13-eb3544d1df2b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515204', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:16:27,564::task::595::TaskManager.Task::(_updateState) Task=`40bfd9a6-5e77-49ee-9f13-eb3544d1df2b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:16:27,568::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:16:27,571::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:16:27,575::task::990::TaskManager.Task::(_decref) Task=`40bfd9a6-5e77-49ee-9f13-eb3544d1df2b`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:16:29,040::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [8cf019c]
>Thread-13::DEBUG::2014-08-21 10:16:29,042::task::595::TaskManager.Task::(_updateState) Task=`3c337762-d7fa-4eb2-bf69-accb87369d23`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:16:29,043::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:16:29,044::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:16:29,044::task::1185::TaskManager.Task::(prepare) Task=`3c337762-d7fa-4eb2-bf69-accb87369d23`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:16:29,045::task::595::TaskManager.Task::(_updateState) Task=`3c337762-d7fa-4eb2-bf69-accb87369d23`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:16:29,045::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:16:29,045::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:16:29,046::task::990::TaskManager.Task::(_decref) Task=`3c337762-d7fa-4eb2-bf69-accb87369d23`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:16:29,051::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [8cf019c]
>Thread-34::DEBUG::2014-08-21 10:16:29,052::task::595::TaskManager.Task::(_updateState) Task=`9952f147-c2b2-49d4-b816-101cd17130ba`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:16:29,052::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:16:29,053::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`de61dc7f-cc62-4cc7-b3cf-37725dcd59e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:16:29,054::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:16:29,054::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:16:29,055::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`de61dc7f-cc62-4cc7-b3cf-37725dcd59e7`::Granted request
>Thread-34::DEBUG::2014-08-21 10:16:29,056::task::827::TaskManager.Task::(resourceAcquired) Task=`9952f147-c2b2-49d4-b816-101cd17130ba`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:16:29,056::task::990::TaskManager.Task::(_decref) Task=`9952f147-c2b2-49d4-b816-101cd17130ba`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:16:29,065::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895867392', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:29,065::task::1185::TaskManager.Task::(prepare) Task=`9952f147-c2b2-49d4-b816-101cd17130ba`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895867392', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:29,065::task::595::TaskManager.Task::(_updateState) Task=`9952f147-c2b2-49d4-b816-101cd17130ba`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:16:29,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:16:29,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:16:29,067::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:16:29,067::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:16:29,068::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:16:29,068::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:16:29,069::task::990::TaskManager.Task::(_decref) Task=`9952f147-c2b2-49d4-b816-101cd17130ba`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:16:29,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:29,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0968294 s, 10.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:31,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:31,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0548395 s, 18.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:33,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:33,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105189 s, 9.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:16:34,702::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:16:34,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000714556 s, 697 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:35,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:36,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.735196 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:38,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:16:39,151::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Thread-13::DEBUG::2014-08-21 10:16:39,154::task::595::TaskManager.Task::(_updateState) Task=`4d053972-a4e0-4365-a12b-13557f5574ac`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:16:39,233::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:16:39,365::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:16:39,368::task::1185::TaskManager.Task::(prepare) Task=`4d053972-a4e0-4365-a12b-13557f5574ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:16:39,369::task::595::TaskManager.Task::(_updateState) Task=`4d053972-a4e0-4365-a12b-13557f5574ac`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:16:39,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:16:39,439::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:16:39,440::task::990::TaskManager.Task::(_decref) Task=`4d053972-a4e0-4365-a12b-13557f5574ac`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:16:40,097::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Thread-34::DEBUG::2014-08-21 10:16:40,099::task::595::TaskManager.Task::(_updateState) Task=`62943945-4507-48c0-b290-dabc4bd502c9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:16:40,100::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:16:40,107::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c72bd696-0e87-4567-99bd-2b2201244654`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:16:40,108::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:16:40,110::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:16:40,117::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c72bd696-0e87-4567-99bd-2b2201244654`::Granted request
>Thread-34::DEBUG::2014-08-21 10:16:40,191::task::827::TaskManager.Task::(resourceAcquired) Task=`62943945-4507-48c0-b290-dabc4bd502c9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:16:40,815::task::990::TaskManager.Task::(_decref) Task=`62943945-4507-48c0-b290-dabc4bd502c9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:16:40,885::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:40,887::task::1185::TaskManager.Task::(prepare) Task=`62943945-4507-48c0-b290-dabc4bd502c9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:40,889::task::595::TaskManager.Task::(_updateState) Task=`62943945-4507-48c0-b290-dabc4bd502c9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:16:40,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:16:40,891::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:16:40,898::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:16:40,909::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:16:40,910::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:16:40,911::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:16:40,912::task::990::TaskManager.Task::(_decref) Task=`62943945-4507-48c0-b290-dabc4bd502c9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:16:41,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.33039 s, 439 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:43,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:16:49,593::task::595::TaskManager.Task::(_updateState) Task=`b4c8384a-1c82-492b-83f7-5e437152f7d0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:16:49,984::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:16:49,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714556', 'lastCheck': '15.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:16:49,990::task::1185::TaskManager.Task::(prepare) Task=`b4c8384a-1c82-492b-83f7-5e437152f7d0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714556', 'lastCheck': '15.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:16:49,991::task::595::TaskManager.Task::(_updateState) Task=`b4c8384a-1c82-492b-83f7-5e437152f7d0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:16:49,992::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:16:49,994::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:16:50,053::task::990::TaskManager.Task::(_decref) Task=`b4c8384a-1c82-492b-83f7-5e437152f7d0`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:16:51,181::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-15::DEBUG::2014-08-21 10:16:51,227::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:16:51,308::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00865363 s, 57.5 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:16:51,426::task::595::TaskManager.Task::(_updateState) Task=`48ae515c-5318-49d2-b353-8b4aa7c818ee`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:16:51,431::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:16:51,435::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:16:51,438::task::1185::TaskManager.Task::(prepare) Task=`48ae515c-5318-49d2-b353-8b4aa7c818ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:16:51,442::task::595::TaskManager.Task::(_updateState) Task=`48ae515c-5318-49d2-b353-8b4aa7c818ee`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:16:51,445::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:16:51,447::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:16:51,451::task::990::TaskManager.Task::(_decref) Task=`48ae515c-5318-49d2-b353-8b4aa7c818ee`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:16:51,465::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-34::DEBUG::2014-08-21 10:16:51,467::task::595::TaskManager.Task::(_updateState) Task=`e929f9ca-1db0-4170-92cb-f714a465770c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:16:51,470::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:16:51,474::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`54dc1358-8bc5-4448-bc12-a7d9364ac0f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:16:51,476::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:16:51,478::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:16:51,480::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`54dc1358-8bc5-4448-bc12-a7d9364ac0f3`::Granted request
>Thread-34::DEBUG::2014-08-21 10:16:51,482::task::827::TaskManager.Task::(resourceAcquired) Task=`e929f9ca-1db0-4170-92cb-f714a465770c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:16:51,483::task::990::TaskManager.Task::(_decref) Task=`e929f9ca-1db0-4170-92cb-f714a465770c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:16:51,504::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:51,505::task::1185::TaskManager.Task::(prepare) Task=`e929f9ca-1db0-4170-92cb-f714a465770c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:16:51,506::task::595::TaskManager.Task::(_updateState) Task=`e929f9ca-1db0-4170-92cb-f714a465770c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:16:51,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:16:51,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:16:51,510::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:16:51,512::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:16:51,513::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:16:51,514::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:16:51,515::task::990::TaskManager.Task::(_decref) Task=`e929f9ca-1db0-4170-92cb-f714a465770c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:16:51,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.45349 s, 417 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:53,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:55,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.32679 s, 772 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:16:57,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:16:58,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102861 s, 10.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:00,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:17:02,017::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-26::DEBUG::2014-08-21 10:17:02,018::task::595::TaskManager.Task::(_updateState) Task=`fb52918a-e2e3-47c3-a6e7-2036915401a8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:02,019::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:17:02,109::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:02,110::task::1185::TaskManager.Task::(prepare) Task=`fb52918a-e2e3-47c3-a6e7-2036915401a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:02,110::task::595::TaskManager.Task::(_updateState) Task=`fb52918a-e2e3-47c3-a6e7-2036915401a8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:02,111::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:02,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:02,111::task::990::TaskManager.Task::(_decref) Task=`fb52918a-e2e3-47c3-a6e7-2036915401a8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:17:02,136::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-34::DEBUG::2014-08-21 10:17:02,137::task::595::TaskManager.Task::(_updateState) Task=`5acde690-5e37-4ce3-8f16-bedacce4429d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:17:02,137::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:17:02,138::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1d79647a-80a2-4438-89d1-aca6c51b2048`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:17:02,139::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 10:17:02,151::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:17:02,168::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:17:02,169::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1d79647a-80a2-4438-89d1-aca6c51b2048`::Granted request
>Thread-34::DEBUG::2014-08-21 10:17:02,170::task::827::TaskManager.Task::(resourceAcquired) Task=`5acde690-5e37-4ce3-8f16-bedacce4429d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:17:02,170::task::990::TaskManager.Task::(_decref) Task=`5acde690-5e37-4ce3-8f16-bedacce4429d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:17:02,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:02,176::task::1185::TaskManager.Task::(prepare) Task=`5acde690-5e37-4ce3-8f16-bedacce4429d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:02,177::task::595::TaskManager.Task::(_updateState) Task=`5acde690-5e37-4ce3-8f16-bedacce4429d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:17:02,177::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:17:02,177::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:17:02,178::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:17:02,178::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:17:02,178::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:17:02,178::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:17:02,179::task::990::TaskManager.Task::(_decref) Task=`5acde690-5e37-4ce3-8f16-bedacce4429d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:17:02,236::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0105336 s, 47.3 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:02,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.17343 s, 471 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:04,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:04,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0880878 s, 11.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:17:05,977::task::595::TaskManager.Task::(_updateState) Task=`bd680786-e0ae-4970-8399-73db2dce2bbe`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:05,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:17:05,979::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0105336', 'lastCheck': '3.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:17:05,982::task::1185::TaskManager.Task::(prepare) Task=`bd680786-e0ae-4970-8399-73db2dce2bbe`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0105336', 'lastCheck': '3.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:17:05,984::task::595::TaskManager.Task::(_updateState) Task=`bd680786-e0ae-4970-8399-73db2dce2bbe`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:05,984::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:05,984::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:05,992::task::990::TaskManager.Task::(_decref) Task=`bd680786-e0ae-4970-8399-73db2dce2bbe`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:17:06,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:07,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0618166 s, 16.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:09,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:09,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.070603 s, 14.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:11,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:11,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049462 s, 20.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:17:12,746::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-26::DEBUG::2014-08-21 10:17:12,747::task::595::TaskManager.Task::(_updateState) Task=`0fe6f94b-bba7-449f-b3bd-122c3f298627`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:12,748::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 10:17:13,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::INFO::2014-08-21 10:17:13,121::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:14,047::task::1185::TaskManager.Task::(prepare) Task=`0fe6f94b-bba7-449f-b3bd-122c3f298627`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:14,048::task::595::TaskManager.Task::(_updateState) Task=`0fe6f94b-bba7-449f-b3bd-122c3f298627`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:14,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:14,056::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:14,057::task::990::TaskManager.Task::(_decref) Task=`0fe6f94b-bba7-449f-b3bd-122c3f298627`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:17:14,084::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:17:14,099::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 10:17:14,101::task::595::TaskManager.Task::(_updateState) Task=`b8233fe1-46c1-4306-8aa6-bf8ab15dc327`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:17:14,101::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:17:14,103::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1063593c-8e04-488c-bc87-0b5a7dfd1234`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:17:14,104::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:17:14,106::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:17:14,115::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1063593c-8e04-488c-bc87-0b5a7dfd1234`::Granted request
>Thread-34::DEBUG::2014-08-21 10:17:14,228::task::827::TaskManager.Task::(resourceAcquired) Task=`b8233fe1-46c1-4306-8aa6-bf8ab15dc327`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:17:14,236::task::990::TaskManager.Task::(_decref) Task=`b8233fe1-46c1-4306-8aa6-bf8ab15dc327`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:17:14,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000717905 s, 694 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:17:14,347::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:14,351::task::1185::TaskManager.Task::(prepare) Task=`b8233fe1-46c1-4306-8aa6-bf8ab15dc327`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:14,355::task::595::TaskManager.Task::(_updateState) Task=`b8233fe1-46c1-4306-8aa6-bf8ab15dc327`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:17:14,359::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:17:14,363::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:17:14,367::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:17:14,370::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:17:14,372::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:17:14,374::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:17:14,377::task::990::TaskManager.Task::(_decref) Task=`b8233fe1-46c1-4306-8aa6-bf8ab15dc327`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:17:14,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.674621 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:16,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:16,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0992385 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:18,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:18,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0703176 s, 14.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:20,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:21,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104484 s, 9.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:17:21,685::task::595::TaskManager.Task::(_updateState) Task=`024f0dab-1276-43fe-807c-b9c27a5a31b0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:21,687::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:17:21,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717905', 'lastCheck': '7.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:17:21,690::task::1185::TaskManager.Task::(prepare) Task=`024f0dab-1276-43fe-807c-b9c27a5a31b0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717905', 'lastCheck': '7.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:17:21,691::task::595::TaskManager.Task::(_updateState) Task=`024f0dab-1276-43fe-807c-b9c27a5a31b0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:21,691::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:21,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:21,692::task::990::TaskManager.Task::(_decref) Task=`024f0dab-1276-43fe-807c-b9c27a5a31b0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:17:23,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:23,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.275049 s, 3.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:17:24,391::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:17:24,425::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-26::DEBUG::2014-08-21 10:17:24,427::task::595::TaskManager.Task::(_updateState) Task=`079e769b-b9bf-4478-89a0-244e0640c335`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:24,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:17:24,429::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:24,429::task::1185::TaskManager.Task::(prepare) Task=`079e769b-b9bf-4478-89a0-244e0640c335`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:24,429::task::595::TaskManager.Task::(_updateState) Task=`079e769b-b9bf-4478-89a0-244e0640c335`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:24,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:24,430::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:24,430::task::990::TaskManager.Task::(_decref) Task=`079e769b-b9bf-4478-89a0-244e0640c335`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:17:24,648::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0197829 s, 25.2 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:17:24,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-34::DEBUG::2014-08-21 10:17:24,998::task::595::TaskManager.Task::(_updateState) Task=`23d8d87d-eb5e-410a-8b60-22d160232c34`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:17:25,011::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:17:25,019::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c3b45e05-170a-4ad1-9411-a1d93fc7f8ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:17:25,023::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:17:25,027::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:17:25,029::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c3b45e05-170a-4ad1-9411-a1d93fc7f8ce`::Granted request
>Thread-34::DEBUG::2014-08-21 10:17:25,033::task::827::TaskManager.Task::(resourceAcquired) Task=`23d8d87d-eb5e-410a-8b60-22d160232c34`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:17:25,034::task::990::TaskManager.Task::(_decref) Task=`23d8d87d-eb5e-410a-8b60-22d160232c34`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:17:25,066::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:25,067::task::1185::TaskManager.Task::(prepare) Task=`23d8d87d-eb5e-410a-8b60-22d160232c34`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:25,069::task::595::TaskManager.Task::(_updateState) Task=`23d8d87d-eb5e-410a-8b60-22d160232c34`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:17:25,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:17:25,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:17:25,074::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:17:25,076::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:17:25,078::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:17:25,080::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:17:25,083::task::990::TaskManager.Task::(_decref) Task=`23d8d87d-eb5e-410a-8b60-22d160232c34`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:17:25,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:25,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.218895 s, 4.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:27,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:28,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0814263 s, 12.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:30,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:30,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.108502 s, 9.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:32,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:33,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.448447 s, 2.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:17:35,048::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:17:35,066::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000602902 s, 826 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:17:35,107::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-26::DEBUG::2014-08-21 10:17:35,109::task::595::TaskManager.Task::(_updateState) Task=`6d61018c-7220-443f-ab16-727f8131aa62`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:35,109::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:17:35,110::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:35,110::task::1185::TaskManager.Task::(prepare) Task=`6d61018c-7220-443f-ab16-727f8131aa62`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:35,110::task::595::TaskManager.Task::(_updateState) Task=`6d61018c-7220-443f-ab16-727f8131aa62`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:35,111::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:35,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:35,111::task::990::TaskManager.Task::(_decref) Task=`6d61018c-7220-443f-ab16-727f8131aa62`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:17:35,116::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-34::DEBUG::2014-08-21 10:17:35,116::task::595::TaskManager.Task::(_updateState) Task=`e5235c88-68b7-413d-9d07-6b0ae3557ae6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:17:35,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:17:35,119::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5363d736-cd57-47ea-b430-60ed699483a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:17:35,120::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Dummy-33::DEBUG::2014-08-21 10:17:35,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:17:35,129::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:17:35,157::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5363d736-cd57-47ea-b430-60ed699483a5`::Granted request
>Thread-34::DEBUG::2014-08-21 10:17:35,161::task::827::TaskManager.Task::(resourceAcquired) Task=`e5235c88-68b7-413d-9d07-6b0ae3557ae6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:17:35,162::task::990::TaskManager.Task::(_decref) Task=`e5235c88-68b7-413d-9d07-6b0ae3557ae6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:17:35,193::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:35,195::task::1185::TaskManager.Task::(prepare) Task=`e5235c88-68b7-413d-9d07-6b0ae3557ae6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:35,197::task::595::TaskManager.Task::(_updateState) Task=`e5235c88-68b7-413d-9d07-6b0ae3557ae6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:17:35,199::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:17:35,201::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:17:35,204::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:17:35,207::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:17:35,208::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:17:35,209::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:17:35,211::task::990::TaskManager.Task::(_decref) Task=`e5235c88-68b7-413d-9d07-6b0ae3557ae6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:17:35,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.174282 s, 5.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:17:36,971::task::595::TaskManager.Task::(_updateState) Task=`104d7f32-3708-45a2-beaf-a12805ae54fd`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:36,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:17:36,972::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602902', 'lastCheck': '1.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:17:36,972::task::1185::TaskManager.Task::(prepare) Task=`104d7f32-3708-45a2-beaf-a12805ae54fd`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602902', 'lastCheck': '1.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:17:36,973::task::595::TaskManager.Task::(_updateState) Task=`104d7f32-3708-45a2-beaf-a12805ae54fd`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:36,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:36,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:36,973::task::990::TaskManager.Task::(_decref) Task=`104d7f32-3708-45a2-beaf-a12805ae54fd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:17:37,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:37,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0784676 s, 13.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:39,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:39,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0740041 s, 13.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:41,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:41,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538051 s, 19.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:43,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:44,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.930303 s, 1.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:17:45,202::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:17:45,259::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-26::DEBUG::2014-08-21 10:17:45,268::task::595::TaskManager.Task::(_updateState) Task=`d0af9dc1-2a7e-4964-b812-2a5991e4fc9d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:45,269::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:17:45,269::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:45,270::task::1185::TaskManager.Task::(prepare) Task=`d0af9dc1-2a7e-4964-b812-2a5991e4fc9d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:45,270::task::595::TaskManager.Task::(_updateState) Task=`d0af9dc1-2a7e-4964-b812-2a5991e4fc9d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:45,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:45,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:45,271::task::990::TaskManager.Task::(_decref) Task=`d0af9dc1-2a7e-4964-b812-2a5991e4fc9d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:17:45,382::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0739955 s, 6.7 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:17:46,322::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-34::DEBUG::2014-08-21 10:17:46,354::task::595::TaskManager.Task::(_updateState) Task=`1b8bc5c6-ee73-4017-b3e2-ad096849969e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:17:46,376::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:17:46,378::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bafe21a0-2436-4f62-ac4b-4b252080bb91`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:17:46,379::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:17:46,380::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:17:46,380::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bafe21a0-2436-4f62-ac4b-4b252080bb91`::Granted request
>Thread-34::DEBUG::2014-08-21 10:17:46,382::task::827::TaskManager.Task::(resourceAcquired) Task=`1b8bc5c6-ee73-4017-b3e2-ad096849969e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:17:46,382::task::990::TaskManager.Task::(_decref) Task=`1b8bc5c6-ee73-4017-b3e2-ad096849969e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:17:46,479::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:46,480::task::1185::TaskManager.Task::(prepare) Task=`1b8bc5c6-ee73-4017-b3e2-ad096849969e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:46,481::task::595::TaskManager.Task::(_updateState) Task=`1b8bc5c6-ee73-4017-b3e2-ad096849969e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:17:46,481::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:17:46,482::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:17:46,483::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:17:46,483::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:17:46,484::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:17:46,484::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:17:46,485::task::990::TaskManager.Task::(_decref) Task=`1b8bc5c6-ee73-4017-b3e2-ad096849969e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:17:47,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:48,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.40344 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:50,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:17:53,011::task::595::TaskManager.Task::(_updateState) Task=`31a2c05e-2a20-48bb-98a7-58e220f1b7c4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:53,013::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:17:53,018::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0739955', 'lastCheck': '6.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:17:53,019::task::1185::TaskManager.Task::(prepare) Task=`31a2c05e-2a20-48bb-98a7-58e220f1b7c4`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0739955', 'lastCheck': '6.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:17:53,020::task::595::TaskManager.Task::(_updateState) Task=`31a2c05e-2a20-48bb-98a7-58e220f1b7c4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:53,020::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:53,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:53,021::task::990::TaskManager.Task::(_decref) Task=`31a2c05e-2a20-48bb-98a7-58e220f1b7c4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:17:54,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.01121 s, 340 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:17:56,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:56,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.151714 s, 6.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:17:56,462::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:17:56,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00516456 s, 96.4 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:17:56,867::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-26::DEBUG::2014-08-21 10:17:56,886::task::595::TaskManager.Task::(_updateState) Task=`1c6dce24-f768-490f-b8d2-ba1f485cfcae`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:17:56,889::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:17:56,901::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:56,905::task::1185::TaskManager.Task::(prepare) Task=`1c6dce24-f768-490f-b8d2-ba1f485cfcae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:17:56,910::task::595::TaskManager.Task::(_updateState) Task=`1c6dce24-f768-490f-b8d2-ba1f485cfcae`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:17:56,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:17:56,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:17:56,929::task::990::TaskManager.Task::(_decref) Task=`1c6dce24-f768-490f-b8d2-ba1f485cfcae`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:17:56,943::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-34::DEBUG::2014-08-21 10:17:56,945::task::595::TaskManager.Task::(_updateState) Task=`48c48323-3c23-4332-abd0-d0adba6c555c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:17:56,947::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:17:56,951::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4caa2e97-811e-4883-821c-89629d49638f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:17:56,952::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:17:56,953::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:17:56,955::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4caa2e97-811e-4883-821c-89629d49638f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:17:56,960::task::827::TaskManager.Task::(resourceAcquired) Task=`48c48323-3c23-4332-abd0-d0adba6c555c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:17:56,961::task::990::TaskManager.Task::(_decref) Task=`48c48323-3c23-4332-abd0-d0adba6c555c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:17:56,984::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:56,986::task::1185::TaskManager.Task::(prepare) Task=`48c48323-3c23-4332-abd0-d0adba6c555c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:17:56,988::task::595::TaskManager.Task::(_updateState) Task=`48c48323-3c23-4332-abd0-d0adba6c555c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:17:56,989::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:17:56,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:17:56,992::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:17:56,993::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:17:56,994::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:17:56,995::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:17:56,997::task::990::TaskManager.Task::(_decref) Task=`48c48323-3c23-4332-abd0-d0adba6c555c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:17:58,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:17:59,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170422 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:01,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:01,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.160761 s, 6.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:03,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:03,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483903 s, 21.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:05,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:05,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0861593 s, 11.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:18:06,531::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:18:06,539::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:18:06,542::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:18:06,553::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:18:06,556::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:18:06,557::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:18:06,557::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 10:18:06,568::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:18:06,582::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000463647 s, 1.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:18:07,212::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-26::DEBUG::2014-08-21 10:18:07,215::task::595::TaskManager.Task::(_updateState) Task=`94f31195-0127-4113-a498-ab1251cfff74`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:18:07,216::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:18:07,217::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:18:07,218::task::1185::TaskManager.Task::(prepare) Task=`94f31195-0127-4113-a498-ab1251cfff74`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:18:07,352::task::595::TaskManager.Task::(_updateState) Task=`94f31195-0127-4113-a498-ab1251cfff74`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:18:07,353::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:18:07,354::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:18:07,368::task::990::TaskManager.Task::(_decref) Task=`94f31195-0127-4113-a498-ab1251cfff74`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:18:07,616::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-34::DEBUG::2014-08-21 10:18:07,630::task::595::TaskManager.Task::(_updateState) Task=`56a6d4b1-9f17-4a42-8db7-71aef85a9e3c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:18:07,644::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:18:07,729::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9a8c2e09-8aff-44cf-a8b2-be49db4d3a2c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:18:07,730::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:18:07,733::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:18:07,747::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9a8c2e09-8aff-44cf-a8b2-be49db4d3a2c`::Granted request
>Thread-34::DEBUG::2014-08-21 10:18:07,778::task::827::TaskManager.Task::(resourceAcquired) Task=`56a6d4b1-9f17-4a42-8db7-71aef85a9e3c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:18:07,779::task::990::TaskManager.Task::(_decref) Task=`56a6d4b1-9f17-4a42-8db7-71aef85a9e3c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:18:07,805::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:07,806::task::1185::TaskManager.Task::(prepare) Task=`56a6d4b1-9f17-4a42-8db7-71aef85a9e3c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:07,806::task::595::TaskManager.Task::(_updateState) Task=`56a6d4b1-9f17-4a42-8db7-71aef85a9e3c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:18:07,807::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:18:07,807::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:18:07,808::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:18:07,808::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:18:07,808::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:18:07,808::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:18:07,809::task::990::TaskManager.Task::(_decref) Task=`56a6d4b1-9f17-4a42-8db7-71aef85a9e3c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:18:08,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:18:08,269::task::595::TaskManager.Task::(_updateState) Task=`3b7195f3-d143-47bc-8d1c-6169b22cb81f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:18:08,270::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:18:08,270::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463647', 'lastCheck': '1.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:18:08,271::task::1185::TaskManager.Task::(prepare) Task=`3b7195f3-d143-47bc-8d1c-6169b22cb81f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463647', 'lastCheck': '1.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:18:08,271::task::595::TaskManager.Task::(_updateState) Task=`3b7195f3-d143-47bc-8d1c-6169b22cb81f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:18:08,272::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:18:08,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:18:08,273::task::990::TaskManager.Task::(_decref) Task=`3b7195f3-d143-47bc-8d1c-6169b22cb81f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:18:08,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.568276 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:10,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:11,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.284851 s, 3.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:13,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:16,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.64446 s, 387 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:18:16,600::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:18:16,622::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00094421 s, 527 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:18:17,827::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-26::DEBUG::2014-08-21 10:18:17,832::task::595::TaskManager.Task::(_updateState) Task=`5bee3a64-ecb5-46b1-952e-46f1f1473f9d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:18:17,833::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:18:17,833::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:18:17,835::task::1185::TaskManager.Task::(prepare) Task=`5bee3a64-ecb5-46b1-952e-46f1f1473f9d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:18:17,836::task::595::TaskManager.Task::(_updateState) Task=`5bee3a64-ecb5-46b1-952e-46f1f1473f9d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:18:17,836::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:18:17,839::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:18:17,840::task::990::TaskManager.Task::(_decref) Task=`5bee3a64-ecb5-46b1-952e-46f1f1473f9d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:18:17,849::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-34::DEBUG::2014-08-21 10:18:17,850::task::595::TaskManager.Task::(_updateState) Task=`6bcf09ce-b26f-43f1-ab7c-01d920bcc4cd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:18:17,851::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:18:17,851::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7403b301-10f0-40c8-bdc5-e01d4b9128eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:18:17,852::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:18:17,852::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:18:17,852::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7403b301-10f0-40c8-bdc5-e01d4b9128eb`::Granted request
>Thread-34::DEBUG::2014-08-21 10:18:17,853::task::827::TaskManager.Task::(resourceAcquired) Task=`6bcf09ce-b26f-43f1-ab7c-01d920bcc4cd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:18:17,853::task::990::TaskManager.Task::(_decref) Task=`6bcf09ce-b26f-43f1-ab7c-01d920bcc4cd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:18:17,857::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:17,857::task::1185::TaskManager.Task::(prepare) Task=`6bcf09ce-b26f-43f1-ab7c-01d920bcc4cd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:17,857::task::595::TaskManager.Task::(_updateState) Task=`6bcf09ce-b26f-43f1-ab7c-01d920bcc4cd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:18:17,857::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:18:17,857::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:18:17,858::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:18:17,858::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:18:17,858::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:18:17,858::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:18:17,858::task::990::TaskManager.Task::(_decref) Task=`6bcf09ce-b26f-43f1-ab7c-01d920bcc4cd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:18:18,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:18,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0694723 s, 14.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:20,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:22,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.06751 s, 495 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:24,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:24,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0930769 s, 11.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:18:25,382::task::595::TaskManager.Task::(_updateState) Task=`a9a4c565-8ab9-4ccd-a752-32be46451143`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:18:25,383::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:18:25,383::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00094421', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:18:25,383::task::1185::TaskManager.Task::(prepare) Task=`a9a4c565-8ab9-4ccd-a752-32be46451143`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00094421', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:18:25,384::task::595::TaskManager.Task::(_updateState) Task=`a9a4c565-8ab9-4ccd-a752-32be46451143`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:18:25,384::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:18:25,384::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:18:25,384::task::990::TaskManager.Task::(_decref) Task=`a9a4c565-8ab9-4ccd-a752-32be46451143`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:18:26,677::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:18:26,754::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00391829 s, 127 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:26,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:27,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.651171 s, 1.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:18:27,905::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-26::DEBUG::2014-08-21 10:18:27,910::task::595::TaskManager.Task::(_updateState) Task=`14d8918a-63f4-4c52-933b-d6464f781b5d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:18:27,913::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:18:27,917::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:18:27,921::task::1185::TaskManager.Task::(prepare) Task=`14d8918a-63f4-4c52-933b-d6464f781b5d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:18:27,924::task::595::TaskManager.Task::(_updateState) Task=`14d8918a-63f4-4c52-933b-d6464f781b5d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:18:27,927::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:18:27,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:18:27,929::task::990::TaskManager.Task::(_decref) Task=`14d8918a-63f4-4c52-933b-d6464f781b5d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:18:27,942::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-34::DEBUG::2014-08-21 10:18:27,946::task::595::TaskManager.Task::(_updateState) Task=`3238e8b1-0da1-4683-a173-ab7fb41fdc1f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:18:27,948::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:18:27,953::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a8647fda-b465-4677-8ddd-a87ae1f36414`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:18:27,954::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:18:27,956::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:18:27,958::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a8647fda-b465-4677-8ddd-a87ae1f36414`::Granted request
>Thread-34::DEBUG::2014-08-21 10:18:27,961::task::827::TaskManager.Task::(resourceAcquired) Task=`3238e8b1-0da1-4683-a173-ab7fb41fdc1f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:18:27,962::task::990::TaskManager.Task::(_decref) Task=`3238e8b1-0da1-4683-a173-ab7fb41fdc1f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:18:28,012::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:28,014::task::1185::TaskManager.Task::(prepare) Task=`3238e8b1-0da1-4683-a173-ab7fb41fdc1f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:28,015::task::595::TaskManager.Task::(_updateState) Task=`3238e8b1-0da1-4683-a173-ab7fb41fdc1f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:18:28,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:18:28,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:18:28,019::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:18:28,021::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:18:28,022::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:18:28,023::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:18:28,024::task::990::TaskManager.Task::(_decref) Task=`3238e8b1-0da1-4683-a173-ab7fb41fdc1f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:18:29,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:29,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110362 s, 9.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:31,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:33,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.701356 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:35,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:35,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.154953 s, 6.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:18:37,008::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:18:37,034::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0015744 s, 316 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:37,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:18:39,351::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-26::DEBUG::2014-08-21 10:18:39,376::task::595::TaskManager.Task::(_updateState) Task=`a635cdfa-0c32-41ac-be67-96046fe72219`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:18:39,387::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:18:39,405::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:18:39,409::task::1185::TaskManager.Task::(prepare) Task=`a635cdfa-0c32-41ac-be67-96046fe72219`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:18:39,411::task::595::TaskManager.Task::(_updateState) Task=`a635cdfa-0c32-41ac-be67-96046fe72219`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:18:39,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:18:39,414::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:18:39,499::task::990::TaskManager.Task::(_decref) Task=`a635cdfa-0c32-41ac-be67-96046fe72219`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:18:39,551::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-34::DEBUG::2014-08-21 10:18:39,561::task::595::TaskManager.Task::(_updateState) Task=`604a20be-45eb-490f-9d42-b3ca0295871d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:18:39,566::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:18:39,574::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d3e1ad5b-f114-4c78-b547-1a7592f29f88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:18:39,577::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:18:39,581::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:18:39,583::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d3e1ad5b-f114-4c78-b547-1a7592f29f88`::Granted request
>Thread-34::DEBUG::2014-08-21 10:18:39,590::task::827::TaskManager.Task::(resourceAcquired) Task=`604a20be-45eb-490f-9d42-b3ca0295871d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:18:39,593::task::990::TaskManager.Task::(_decref) Task=`604a20be-45eb-490f-9d42-b3ca0295871d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:18:39,652::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:39,655::task::1185::TaskManager.Task::(prepare) Task=`604a20be-45eb-490f-9d42-b3ca0295871d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:39,659::task::595::TaskManager.Task::(_updateState) Task=`604a20be-45eb-490f-9d42-b3ca0295871d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:18:39,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:18:39,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:18:39,671::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:18:39,673::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:18:39,675::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:18:39,677::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:18:39,680::task::990::TaskManager.Task::(_decref) Task=`604a20be-45eb-490f-9d42-b3ca0295871d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:18:39,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.96867 s, 520 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:18:40,535::task::595::TaskManager.Task::(_updateState) Task=`ca893191-d7db-494d-9be0-2520922e2464`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:18:40,536::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:18:40,536::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015744', 'lastCheck': '3.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:18:40,537::task::1185::TaskManager.Task::(prepare) Task=`ca893191-d7db-494d-9be0-2520922e2464`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015744', 'lastCheck': '3.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:18:40,537::task::595::TaskManager.Task::(_updateState) Task=`ca893191-d7db-494d-9be0-2520922e2464`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:18:40,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:18:40,538::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:18:40,538::task::990::TaskManager.Task::(_decref) Task=`ca893191-d7db-494d-9be0-2520922e2464`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:18:42,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:18:50,685::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-13::DEBUG::2014-08-21 10:18:51,112::task::595::TaskManager.Task::(_updateState) Task=`03bcdd28-59a1-4912-a7e9-a7e7040e9431`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:18:51,390::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:18:51,391::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:18:51,392::task::1185::TaskManager.Task::(prepare) Task=`03bcdd28-59a1-4912-a7e9-a7e7040e9431`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:18:51,467::task::595::TaskManager.Task::(_updateState) Task=`03bcdd28-59a1-4912-a7e9-a7e7040e9431`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:18:51,779::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Dummy-33::DEBUG::2014-08-21 10:18:51,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.0509 s, 974 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:18:51,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 10:18:52,261::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:18:52,887::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0079868 s, 62.4 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:18:52,193::task::990::TaskManager.Task::(_decref) Task=`03bcdd28-59a1-4912-a7e9-a7e7040e9431`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:18:53,339::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-34::DEBUG::2014-08-21 10:18:53,346::task::595::TaskManager.Task::(_updateState) Task=`7f49cbca-566c-42fb-bd74-e9583b5388f1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:18:53,347::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:18:53,348::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d5a0b9ca-e186-4d9e-b25b-38da0e8a8b71`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:18:53,348::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:18:53,349::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:18:53,349::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d5a0b9ca-e186-4d9e-b25b-38da0e8a8b71`::Granted request
>Thread-34::DEBUG::2014-08-21 10:18:53,350::task::827::TaskManager.Task::(resourceAcquired) Task=`7f49cbca-566c-42fb-bd74-e9583b5388f1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:18:53,350::task::990::TaskManager.Task::(_decref) Task=`7f49cbca-566c-42fb-bd74-e9583b5388f1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:18:53,360::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:53,361::task::1185::TaskManager.Task::(prepare) Task=`7f49cbca-566c-42fb-bd74-e9583b5388f1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:18:53,361::task::595::TaskManager.Task::(_updateState) Task=`7f49cbca-566c-42fb-bd74-e9583b5388f1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:18:53,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:18:53,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:18:53,365::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:18:53,366::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:18:53,367::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:18:53,367::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:18:53,380::task::990::TaskManager.Task::(_decref) Task=`7f49cbca-566c-42fb-bd74-e9583b5388f1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:18:54,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:54,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.289736 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:56,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:57,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0716583 s, 14.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:18:59,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:18:59,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0600786 s, 17.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:01,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:19:02,065::task::595::TaskManager.Task::(_updateState) Task=`9586b3ad-f267-4450-885a-06fa479b7d36`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:19:02,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:19:02,069::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0079868', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:19:02,070::task::1185::TaskManager.Task::(prepare) Task=`9586b3ad-f267-4450-885a-06fa479b7d36`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0079868', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:19:02,070::task::595::TaskManager.Task::(_updateState) Task=`9586b3ad-f267-4450-885a-06fa479b7d36`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:19:02,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:19:02,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:19:02,070::task::990::TaskManager.Task::(_decref) Task=`9586b3ad-f267-4450-885a-06fa479b7d36`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:19:02,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.737383 s, 1.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:19:03,317::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:19:03,336::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00165292 s, 301 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:19:03,494::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 10:19:03,495::task::595::TaskManager.Task::(_updateState) Task=`1a912741-7be6-49ca-87e1-92afd4b23179`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:19:03,496::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:19:03,496::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:19:03,497::task::1185::TaskManager.Task::(prepare) Task=`1a912741-7be6-49ca-87e1-92afd4b23179`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:19:03,497::task::595::TaskManager.Task::(_updateState) Task=`1a912741-7be6-49ca-87e1-92afd4b23179`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:19:03,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:19:03,498::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:19:03,498::task::990::TaskManager.Task::(_decref) Task=`1a912741-7be6-49ca-87e1-92afd4b23179`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:19:03,506::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 10:19:03,507::task::595::TaskManager.Task::(_updateState) Task=`c1512324-eb5f-4330-9308-e6d252aa6e36`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:19:03,507::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:19:03,510::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cca28a2d-cc83-4c09-b38e-7d01fe94781b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:19:03,511::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:19:03,511::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:19:03,512::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cca28a2d-cc83-4c09-b38e-7d01fe94781b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:19:03,512::task::827::TaskManager.Task::(resourceAcquired) Task=`c1512324-eb5f-4330-9308-e6d252aa6e36`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:19:03,513::task::990::TaskManager.Task::(_decref) Task=`c1512324-eb5f-4330-9308-e6d252aa6e36`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:19:03,521::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:03,522::task::1185::TaskManager.Task::(prepare) Task=`c1512324-eb5f-4330-9308-e6d252aa6e36`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:03,523::task::595::TaskManager.Task::(_updateState) Task=`c1512324-eb5f-4330-9308-e6d252aa6e36`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:19:03,524::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:19:03,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:19:03,526::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:19:03,527::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:19:03,527::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:19:03,528::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:19:03,528::task::990::TaskManager.Task::(_decref) Task=`c1512324-eb5f-4330-9308-e6d252aa6e36`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:19:04,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:04,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0857719 s, 11.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:06,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:06,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0787132 s, 13.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:08,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:09,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.81309 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:11,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:11,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0879442 s, 11.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:14,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:19:14,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:19:14,307::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [377be1f8]
>Thread-13::DEBUG::2014-08-21 10:19:14,308::task::595::TaskManager.Task::(_updateState) Task=`cbd735c7-c4bf-4e2d-8f7c-cadec71888e8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:19:14,309::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:19:14,309::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:19:14,310::task::1185::TaskManager.Task::(prepare) Task=`cbd735c7-c4bf-4e2d-8f7c-cadec71888e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:19:14,310::task::595::TaskManager.Task::(_updateState) Task=`cbd735c7-c4bf-4e2d-8f7c-cadec71888e8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:19:14,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:19:14,311::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:19:14,311::task::990::TaskManager.Task::(_decref) Task=`cbd735c7-c4bf-4e2d-8f7c-cadec71888e8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:19:14,481::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [377be1f8]
>Thread-34::DEBUG::2014-08-21 10:19:14,483::task::595::TaskManager.Task::(_updateState) Task=`f3d4cbd3-842d-4881-957c-a2985e569540`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:19:14,484::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:19:14,485::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3a33ee35-ad8c-40d2-a73f-91cdf210a165`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:19:14,486::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:19:14,533::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:19:14,534::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3a33ee35-ad8c-40d2-a73f-91cdf210a165`::Granted request
>Thread-34::DEBUG::2014-08-21 10:19:14,536::task::827::TaskManager.Task::(resourceAcquired) Task=`f3d4cbd3-842d-4881-957c-a2985e569540`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:19:14,537::task::990::TaskManager.Task::(_decref) Task=`f3d4cbd3-842d-4881-957c-a2985e569540`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:19:14,596::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:14,597::task::1185::TaskManager.Task::(prepare) Task=`f3d4cbd3-842d-4881-957c-a2985e569540`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:14,597::task::595::TaskManager.Task::(_updateState) Task=`f3d4cbd3-842d-4881-957c-a2985e569540`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:19:14,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:19:14,598::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:19:14,599::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:19:14,600::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:19:14,600::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:19:14,600::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:19:14,601::task::990::TaskManager.Task::(_decref) Task=`f3d4cbd3-842d-4881-957c-a2985e569540`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:19:14,682::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0186818 s, 26.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:14,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.636022 s, 1.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:16,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:17,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0848618 s, 12.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:19:17,431::task::595::TaskManager.Task::(_updateState) Task=`a1aced0d-81d0-4540-9e1c-00cb4f718a6b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:19:17,431::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:19:17,432::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0186818', 'lastCheck': '2.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:19:17,432::task::1185::TaskManager.Task::(prepare) Task=`a1aced0d-81d0-4540-9e1c-00cb4f718a6b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0186818', 'lastCheck': '2.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:19:17,432::task::595::TaskManager.Task::(_updateState) Task=`a1aced0d-81d0-4540-9e1c-00cb4f718a6b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:19:17,432::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:19:17,433::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:19:17,433::task::990::TaskManager.Task::(_decref) Task=`a1aced0d-81d0-4540-9e1c-00cb4f718a6b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:19:19,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:19,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.122922 s, 8.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:21,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:21,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103487 s, 9.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:23,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:23,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473756 s, 21.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:19:24,621::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-13::DEBUG::2014-08-21 10:19:24,623::task::595::TaskManager.Task::(_updateState) Task=`20399ff6-de21-47af-970f-d92ec8dc131e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:19:24,623::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:19:24,624::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:19:24,624::task::1185::TaskManager.Task::(prepare) Task=`20399ff6-de21-47af-970f-d92ec8dc131e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:19:24,624::task::595::TaskManager.Task::(_updateState) Task=`20399ff6-de21-47af-970f-d92ec8dc131e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:19:24,624::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:19:24,624::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:19:24,625::task::990::TaskManager.Task::(_decref) Task=`20399ff6-de21-47af-970f-d92ec8dc131e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:19:24,631::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-34::DEBUG::2014-08-21 10:19:24,632::task::595::TaskManager.Task::(_updateState) Task=`69258c84-8a89-4156-b1a8-1c9ae284e73e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:19:24,633::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:19:24,634::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`68d1eafd-e389-4b2b-a7e2-2fb49bc2ffac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:19:24,635::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:19:24,637::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:19:24,638::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`68d1eafd-e389-4b2b-a7e2-2fb49bc2ffac`::Granted request
>Thread-34::DEBUG::2014-08-21 10:19:24,639::task::827::TaskManager.Task::(resourceAcquired) Task=`69258c84-8a89-4156-b1a8-1c9ae284e73e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:19:24,639::task::990::TaskManager.Task::(_decref) Task=`69258c84-8a89-4156-b1a8-1c9ae284e73e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:19:24,645::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:24,645::task::1185::TaskManager.Task::(prepare) Task=`69258c84-8a89-4156-b1a8-1c9ae284e73e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:24,646::task::595::TaskManager.Task::(_updateState) Task=`69258c84-8a89-4156-b1a8-1c9ae284e73e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:19:24,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:19:24,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:19:24,648::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:19:24,649::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:19:24,650::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:19:24,650::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:19:24,657::task::990::TaskManager.Task::(_decref) Task=`69258c84-8a89-4156-b1a8-1c9ae284e73e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:19:24,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:19:24,915::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000836402 s, 595 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:25,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:26,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.131364 s, 7.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:28,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:28,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.179855 s, 5.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:30,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:30,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.286082 s, 3.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:19:32,644::task::595::TaskManager.Task::(_updateState) Task=`0eacfc3c-7bfc-4e94-9250-a717ed051ff9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:19:32,645::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:19:32,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000836402', 'lastCheck': '7.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:19:32,646::task::1185::TaskManager.Task::(prepare) Task=`0eacfc3c-7bfc-4e94-9250-a717ed051ff9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000836402', 'lastCheck': '7.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:19:32,647::task::595::TaskManager.Task::(_updateState) Task=`0eacfc3c-7bfc-4e94-9250-a717ed051ff9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:19:32,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:19:32,648::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:19:32,648::task::990::TaskManager.Task::(_decref) Task=`0eacfc3c-7bfc-4e94-9250-a717ed051ff9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:19:32,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:33,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.521431 s, 2.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:19:35,255::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-13::DEBUG::2014-08-21 10:19:35,583::task::595::TaskManager.Task::(_updateState) Task=`f78e03c3-0432-4dc0-82fb-c99b0365704e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:19:35,691::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:19:35,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:19:35,712::task::1185::TaskManager.Task::(prepare) Task=`f78e03c3-0432-4dc0-82fb-c99b0365704e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:19:35,712::task::595::TaskManager.Task::(_updateState) Task=`f78e03c3-0432-4dc0-82fb-c99b0365704e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:19:35,737::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:19:35,738::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:19:35,738::task::990::TaskManager.Task::(_decref) Task=`f78e03c3-0432-4dc0-82fb-c99b0365704e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:19:36,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:19:36,196::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-34::DEBUG::2014-08-21 10:19:36,213::task::595::TaskManager.Task::(_updateState) Task=`e3f27e8f-d736-4ed4-8692-aa3ff95719dd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:19:36,404::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:19:36,406::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`57e2fb4a-fad0-4ebd-98a1-ee0fe0e71ac6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:19:36,406::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:19:36,406::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:19:36,407::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`57e2fb4a-fad0-4ebd-98a1-ee0fe0e71ac6`::Granted request
>Thread-34::DEBUG::2014-08-21 10:19:36,407::task::827::TaskManager.Task::(resourceAcquired) Task=`e3f27e8f-d736-4ed4-8692-aa3ff95719dd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:19:36,408::task::990::TaskManager.Task::(_decref) Task=`e3f27e8f-d736-4ed4-8692-aa3ff95719dd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:19:36,495::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:36,503::task::1185::TaskManager.Task::(prepare) Task=`e3f27e8f-d736-4ed4-8692-aa3ff95719dd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:36,504::task::595::TaskManager.Task::(_updateState) Task=`e3f27e8f-d736-4ed4-8692-aa3ff95719dd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:19:36,504::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:19:36,505::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:19:36,512::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:19:36,515::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:19:36,515::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:19:36,515::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:19:36,516::task::990::TaskManager.Task::(_decref) Task=`e3f27e8f-d736-4ed4-8692-aa3ff95719dd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:19:38,628::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:19:39,162::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0025083 s, 199 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:41,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.45525 s, 230 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:43,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:43,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.169835 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:45,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:45,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.076408 s, 13.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:19:46,902::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2d92e2f2]
>Thread-26::DEBUG::2014-08-21 10:19:46,905::task::595::TaskManager.Task::(_updateState) Task=`94ce6566-63cf-45a6-80e8-02d6dff66c14`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:19:46,905::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:19:46,906::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:19:46,907::task::1185::TaskManager.Task::(prepare) Task=`94ce6566-63cf-45a6-80e8-02d6dff66c14`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:19:46,907::task::595::TaskManager.Task::(_updateState) Task=`94ce6566-63cf-45a6-80e8-02d6dff66c14`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:19:46,908::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:19:46,909::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:19:46,909::task::990::TaskManager.Task::(_decref) Task=`94ce6566-63cf-45a6-80e8-02d6dff66c14`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:19:46,915::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2d92e2f2]
>Thread-34::DEBUG::2014-08-21 10:19:46,916::task::595::TaskManager.Task::(_updateState) Task=`b68e6fdd-4ab6-4d77-a49d-79e43af88c0c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:19:46,917::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:19:46,917::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d26eec05-2328-41b2-8f5b-966cd52dbae7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:19:46,918::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:19:46,918::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:19:46,919::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d26eec05-2328-41b2-8f5b-966cd52dbae7`::Granted request
>Thread-34::DEBUG::2014-08-21 10:19:46,919::task::827::TaskManager.Task::(resourceAcquired) Task=`b68e6fdd-4ab6-4d77-a49d-79e43af88c0c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:19:46,920::task::990::TaskManager.Task::(_decref) Task=`b68e6fdd-4ab6-4d77-a49d-79e43af88c0c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:19:46,928::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:46,929::task::1185::TaskManager.Task::(prepare) Task=`b68e6fdd-4ab6-4d77-a49d-79e43af88c0c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:46,929::task::595::TaskManager.Task::(_updateState) Task=`b68e6fdd-4ab6-4d77-a49d-79e43af88c0c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:19:46,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:19:46,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:19:46,931::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:19:46,931::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:19:46,932::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:19:46,932::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:19:46,933::task::990::TaskManager.Task::(_decref) Task=`b68e6fdd-4ab6-4d77-a49d-79e43af88c0c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:19:47,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:47,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121459 s, 8.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:19:48,576::task::595::TaskManager.Task::(_updateState) Task=`d52be787-712e-4d66-a5f9-1e9a1cbe3a7e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:19:48,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:19:48,577::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0025083', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:19:48,577::task::1185::TaskManager.Task::(prepare) Task=`d52be787-712e-4d66-a5f9-1e9a1cbe3a7e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0025083', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:19:48,578::task::595::TaskManager.Task::(_updateState) Task=`d52be787-712e-4d66-a5f9-1e9a1cbe3a7e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:19:48,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:19:48,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:19:48,578::task::990::TaskManager.Task::(_decref) Task=`d52be787-712e-4d66-a5f9-1e9a1cbe3a7e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:19:49,641::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:19:49,704::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00460686 s, 108 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:49,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:50,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125085 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:52,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:53,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.379693 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:19:56,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:19:56,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0919085 s, 11.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:19:56,947::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-26::DEBUG::2014-08-21 10:19:56,948::task::595::TaskManager.Task::(_updateState) Task=`52bbc3f9-6d26-4200-8a86-761d7ca4981f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:19:56,949::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:19:56,949::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:19:56,949::task::1185::TaskManager.Task::(prepare) Task=`52bbc3f9-6d26-4200-8a86-761d7ca4981f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:19:56,950::task::595::TaskManager.Task::(_updateState) Task=`52bbc3f9-6d26-4200-8a86-761d7ca4981f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:19:56,950::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:19:56,950::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:19:56,950::task::990::TaskManager.Task::(_decref) Task=`52bbc3f9-6d26-4200-8a86-761d7ca4981f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:19:56,955::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 10:19:56,956::task::595::TaskManager.Task::(_updateState) Task=`ad2c1857-cf72-4f55-8b9a-e0e310746480`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:19:56,956::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:19:56,957::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7b338e83-5174-47d5-afe4-e5452f50b88d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:19:56,957::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:19:56,957::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:19:56,957::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7b338e83-5174-47d5-afe4-e5452f50b88d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:19:56,958::task::827::TaskManager.Task::(resourceAcquired) Task=`ad2c1857-cf72-4f55-8b9a-e0e310746480`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:19:56,958::task::990::TaskManager.Task::(_decref) Task=`ad2c1857-cf72-4f55-8b9a-e0e310746480`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:19:56,963::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897309184', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:56,963::task::1185::TaskManager.Task::(prepare) Task=`ad2c1857-cf72-4f55-8b9a-e0e310746480`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897309184', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:19:56,964::task::595::TaskManager.Task::(_updateState) Task=`ad2c1857-cf72-4f55-8b9a-e0e310746480`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:19:56,964::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:19:56,964::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:19:56,965::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:19:56,965::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:19:56,965::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:19:56,965::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:19:56,965::task::990::TaskManager.Task::(_decref) Task=`ad2c1857-cf72-4f55-8b9a-e0e310746480`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:19:58,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:00,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.12994 s, 481 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:03,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:20:05,198::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:20:05,551::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00503516 s, 98.9 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:20:12,482::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-26::DEBUG::2014-08-21 10:20:12,773::task::595::TaskManager.Task::(_updateState) Task=`680f71b2-81e1-4a29-89f2-2398f897f57c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:20:12,809::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::DEBUG::2014-08-21 10:20:12,861::task::595::TaskManager.Task::(_updateState) Task=`aa26db59-5119-4eb5-9045-5a5a4a97b00a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:20:12,869::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:20:12,897::task::1185::TaskManager.Task::(prepare) Task=`680f71b2-81e1-4a29-89f2-2398f897f57c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::INFO::2014-08-21 10:20:12,930::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::DEBUG::2014-08-21 10:20:12,913::task::595::TaskManager.Task::(_updateState) Task=`680f71b2-81e1-4a29-89f2-2398f897f57c`::moving from state preparing -> state finished
>Thread-13::INFO::2014-08-21 10:20:12,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00503516', 'lastCheck': '6.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:20:12,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:20:12,970::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:20:12,975::task::1185::TaskManager.Task::(prepare) Task=`aa26db59-5119-4eb5-9045-5a5a4a97b00a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00503516', 'lastCheck': '6.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:20:12,978::task::990::TaskManager.Task::(_decref) Task=`680f71b2-81e1-4a29-89f2-2398f897f57c`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:20:12,988::task::595::TaskManager.Task::(_updateState) Task=`aa26db59-5119-4eb5-9045-5a5a4a97b00a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:20:13,001::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:20:13,005::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:20:13,016::task::990::TaskManager.Task::(_decref) Task=`aa26db59-5119-4eb5-9045-5a5a4a97b00a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:20:13,078::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-34::DEBUG::2014-08-21 10:20:13,079::task::595::TaskManager.Task::(_updateState) Task=`881e4a85-561d-4825-8654-d695819d74d0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:20:13,194::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:20:13,198::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8b61072f-0574-496c-ad4f-7ae95e55e2a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:20:13,201::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:20:13,203::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:20:13,205::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8b61072f-0574-496c-ad4f-7ae95e55e2a5`::Granted request
>Thread-34::DEBUG::2014-08-21 10:20:13,208::task::827::TaskManager.Task::(resourceAcquired) Task=`881e4a85-561d-4825-8654-d695819d74d0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:20:13,208::task::990::TaskManager.Task::(_decref) Task=`881e4a85-561d-4825-8654-d695819d74d0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:20:13,221::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:13,222::task::1185::TaskManager.Task::(prepare) Task=`881e4a85-561d-4825-8654-d695819d74d0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:13,222::task::595::TaskManager.Task::(_updateState) Task=`881e4a85-561d-4825-8654-d695819d74d0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:20:13,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:20:13,222::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:20:13,231::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:20:13,236::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:20:13,243::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:20:13,243::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:20:13,245::task::990::TaskManager.Task::(_decref) Task=`881e4a85-561d-4825-8654-d695819d74d0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:20:13,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 9.43469 s, 109 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:16,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:20:16,464::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:20:16,515::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00174945 s, 285 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:16,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.135381 s, 7.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:18,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:18,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0680316 s, 15.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:20,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:21,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.426008 s, 2.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:20:23,267::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-13::DEBUG::2014-08-21 10:20:23,268::task::595::TaskManager.Task::(_updateState) Task=`a725c088-d1cf-497e-b131-0515a7b59cb6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:20:23,269::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:20:23,269::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:20:23,270::task::1185::TaskManager.Task::(prepare) Task=`a725c088-d1cf-497e-b131-0515a7b59cb6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:20:23,270::task::595::TaskManager.Task::(_updateState) Task=`a725c088-d1cf-497e-b131-0515a7b59cb6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:20:23,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:20:23,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:20:23,271::task::990::TaskManager.Task::(_decref) Task=`a725c088-d1cf-497e-b131-0515a7b59cb6`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:20:23,278::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-34::DEBUG::2014-08-21 10:20:23,280::task::595::TaskManager.Task::(_updateState) Task=`138ac69e-0c9d-4ca1-bb64-4f3bbc754b0f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:20:23,280::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:20:23,281::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`264cdea1-dce3-4c13-b2e1-a448c13fa41f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:20:23,283::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:20:23,284::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:20:23,284::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`264cdea1-dce3-4c13-b2e1-a448c13fa41f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:20:23,285::task::827::TaskManager.Task::(resourceAcquired) Task=`138ac69e-0c9d-4ca1-bb64-4f3bbc754b0f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:20:23,285::task::990::TaskManager.Task::(_decref) Task=`138ac69e-0c9d-4ca1-bb64-4f3bbc754b0f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:20:23,293::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:23,294::task::1185::TaskManager.Task::(prepare) Task=`138ac69e-0c9d-4ca1-bb64-4f3bbc754b0f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:23,294::task::595::TaskManager.Task::(_updateState) Task=`138ac69e-0c9d-4ca1-bb64-4f3bbc754b0f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:20:23,295::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:20:23,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:20:23,295::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:20:23,296::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:20:23,296::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:20:23,296::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:20:23,297::task::990::TaskManager.Task::(_decref) Task=`138ac69e-0c9d-4ca1-bb64-4f3bbc754b0f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:20:23,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:24,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.700308 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:26,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:20:27,369::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:20:27,884::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00717269 s, 69.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:27,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.19105 s, 860 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:20:28,509::task::595::TaskManager.Task::(_updateState) Task=`2edd7f3d-3e86-4cde-9805-27700b0a53a7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:20:28,510::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:20:28,510::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00717269', 'lastCheck': '0.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:20:28,511::task::1185::TaskManager.Task::(prepare) Task=`2edd7f3d-3e86-4cde-9805-27700b0a53a7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00717269', 'lastCheck': '0.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:20:28,511::task::595::TaskManager.Task::(_updateState) Task=`2edd7f3d-3e86-4cde-9805-27700b0a53a7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:20:28,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:20:28,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:20:28,513::task::990::TaskManager.Task::(_decref) Task=`2edd7f3d-3e86-4cde-9805-27700b0a53a7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:20:30,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:31,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.617297 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:33,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:20:33,330::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-13::DEBUG::2014-08-21 10:20:33,344::task::595::TaskManager.Task::(_updateState) Task=`7962edbb-dc3e-49b6-b71f-1a1124ca4d10`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:20:33,345::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:20:33,346::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:20:33,457::task::1185::TaskManager.Task::(prepare) Task=`7962edbb-dc3e-49b6-b71f-1a1124ca4d10`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:20:33,459::task::595::TaskManager.Task::(_updateState) Task=`7962edbb-dc3e-49b6-b71f-1a1124ca4d10`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:20:33,617::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:20:33,618::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:20:33,618::task::990::TaskManager.Task::(_decref) Task=`7962edbb-dc3e-49b6-b71f-1a1124ca4d10`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:20:33,783::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-34::DEBUG::2014-08-21 10:20:33,860::task::595::TaskManager.Task::(_updateState) Task=`323824f2-38c9-4823-b1dc-69e1d17d5a6e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:20:33,861::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:20:33,863::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6e9d1ac1-0b57-417f-bede-cab6b805160d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:20:33,863::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:20:33,864::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:20:33,864::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6e9d1ac1-0b57-417f-bede-cab6b805160d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:20:33,866::task::827::TaskManager.Task::(resourceAcquired) Task=`323824f2-38c9-4823-b1dc-69e1d17d5a6e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:20:33,866::task::990::TaskManager.Task::(_decref) Task=`323824f2-38c9-4823-b1dc-69e1d17d5a6e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:20:33,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:33,932::task::1185::TaskManager.Task::(prepare) Task=`323824f2-38c9-4823-b1dc-69e1d17d5a6e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:33,935::task::595::TaskManager.Task::(_updateState) Task=`323824f2-38c9-4823-b1dc-69e1d17d5a6e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:20:33,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:20:33,939::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:20:33,941::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:20:33,956::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:20:33,957::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:20:33,958::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:20:33,976::task::990::TaskManager.Task::(_decref) Task=`323824f2-38c9-4823-b1dc-69e1d17d5a6e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:20:34,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.729096 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:36,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:36,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.079311 s, 12.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:38,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:20:38,498::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:20:38,561::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00351329 s, 142 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:39,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.273193 s, 3.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:41,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:42,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.569704 s, 1.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:20:43,727::task::595::TaskManager.Task::(_updateState) Task=`419ae649-82ef-49e5-9e49-876f730582e3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:20:43,728::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:20:43,728::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00351329', 'lastCheck': '5.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:20:43,729::task::1185::TaskManager.Task::(prepare) Task=`419ae649-82ef-49e5-9e49-876f730582e3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00351329', 'lastCheck': '5.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:20:43,729::task::595::TaskManager.Task::(_updateState) Task=`419ae649-82ef-49e5-9e49-876f730582e3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:20:43,729::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:20:43,729::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:20:43,730::task::990::TaskManager.Task::(_decref) Task=`419ae649-82ef-49e5-9e49-876f730582e3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:20:44,030::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-13::DEBUG::2014-08-21 10:20:44,031::task::595::TaskManager.Task::(_updateState) Task=`d6b6d473-5fa0-45f3-baa5-039f04305dc1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:20:44,031::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:20:44,032::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:20:44,032::task::1185::TaskManager.Task::(prepare) Task=`d6b6d473-5fa0-45f3-baa5-039f04305dc1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:20:44,033::task::595::TaskManager.Task::(_updateState) Task=`d6b6d473-5fa0-45f3-baa5-039f04305dc1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:20:44,033::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:20:44,033::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:20:44,034::task::990::TaskManager.Task::(_decref) Task=`d6b6d473-5fa0-45f3-baa5-039f04305dc1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:20:44,040::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-34::DEBUG::2014-08-21 10:20:44,041::task::595::TaskManager.Task::(_updateState) Task=`d5547cdf-f876-4cda-a936-8a45f61a0c3b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:20:44,042::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:20:44,044::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`118bf0bc-e042-4a55-91db-7a9ab45e951f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:20:44,045::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:20:44,045::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:20:44,046::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`118bf0bc-e042-4a55-91db-7a9ab45e951f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:20:44,047::task::827::TaskManager.Task::(resourceAcquired) Task=`d5547cdf-f876-4cda-a936-8a45f61a0c3b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:20:44,047::task::990::TaskManager.Task::(_decref) Task=`d5547cdf-f876-4cda-a936-8a45f61a0c3b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:20:44,097::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:44,097::task::1185::TaskManager.Task::(prepare) Task=`d5547cdf-f876-4cda-a936-8a45f61a0c3b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:44,098::task::595::TaskManager.Task::(_updateState) Task=`d5547cdf-f876-4cda-a936-8a45f61a0c3b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:20:44,098::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:20:44,098::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:20:44,210::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:20:44,211::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:20:44,212::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:20:44,213::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:20:44,214::task::990::TaskManager.Task::(_decref) Task=`d5547cdf-f876-4cda-a936-8a45f61a0c3b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:20:44,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:44,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.133848 s, 7.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:46,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:47,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.767091 s, 1.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:20:48,645::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:20:48,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000531459 s, 937 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:49,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:49,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124674 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:51,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:20:54,550::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-13::DEBUG::2014-08-21 10:20:54,552::task::595::TaskManager.Task::(_updateState) Task=`5e037acc-9f2c-42e2-aa9a-dfe9b8b271a1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:20:54,553::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:20:54,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:20:54,558::task::1185::TaskManager.Task::(prepare) Task=`5e037acc-9f2c-42e2-aa9a-dfe9b8b271a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:20:54,559::task::595::TaskManager.Task::(_updateState) Task=`5e037acc-9f2c-42e2-aa9a-dfe9b8b271a1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:20:54,559::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:20:54,559::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:20:54,560::task::990::TaskManager.Task::(_decref) Task=`5e037acc-9f2c-42e2-aa9a-dfe9b8b271a1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:20:54,784::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-34::DEBUG::2014-08-21 10:20:54,912::task::595::TaskManager.Task::(_updateState) Task=`1a4948ad-430f-447e-8372-f8a144330859`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:20:54,913::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:20:54,947::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6a8d941d-cc6f-4b53-ba46-e484087fd500`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:20:54,948::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:20:55,032::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:20:55,032::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6a8d941d-cc6f-4b53-ba46-e484087fd500`::Granted request
>Thread-34::DEBUG::2014-08-21 10:20:55,124::task::827::TaskManager.Task::(resourceAcquired) Task=`1a4948ad-430f-447e-8372-f8a144330859`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:20:55,129::task::990::TaskManager.Task::(_decref) Task=`1a4948ad-430f-447e-8372-f8a144330859`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:20:55,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:55,203::task::1185::TaskManager.Task::(prepare) Task=`1a4948ad-430f-447e-8372-f8a144330859`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:20:55,205::task::595::TaskManager.Task::(_updateState) Task=`1a4948ad-430f-447e-8372-f8a144330859`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:20:55,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:20:55,207::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:20:55,209::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:20:55,210::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:20:55,211::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:20:55,211::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:20:55,212::task::990::TaskManager.Task::(_decref) Task=`1a4948ad-430f-447e-8372-f8a144330859`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:20:55,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.17818 s, 470 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:20:57,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:20:57,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460463 s, 22.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:00,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:21:00,147::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:21:01,577::task::595::TaskManager.Task::(_updateState) Task=`524d1c33-a9c4-41e4-953b-c0aad281a041`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:21:01,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:21:01,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531459', 'lastCheck': '12.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:21:01,595::task::1185::TaskManager.Task::(prepare) Task=`524d1c33-a9c4-41e4-953b-c0aad281a041`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531459', 'lastCheck': '12.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:21:01,595::task::595::TaskManager.Task::(_updateState) Task=`524d1c33-a9c4-41e4-953b-c0aad281a041`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:21:01,596::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:21:01,596::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:21:01,621::task::990::TaskManager.Task::(_decref) Task=`524d1c33-a9c4-41e4-953b-c0aad281a041`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:21:02,703::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00145877 s, 341 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:03,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.95015 s, 525 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:21:05,338::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-13::DEBUG::2014-08-21 10:21:05,361::task::595::TaskManager.Task::(_updateState) Task=`bb87824d-86f9-4a85-acf3-073355c95d30`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:21:05,362::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:21:05,363::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:05,389::task::1185::TaskManager.Task::(prepare) Task=`bb87824d-86f9-4a85-acf3-073355c95d30`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:05,391::task::595::TaskManager.Task::(_updateState) Task=`bb87824d-86f9-4a85-acf3-073355c95d30`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:21:05,391::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:21:05,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:21:05,470::task::990::TaskManager.Task::(_decref) Task=`bb87824d-86f9-4a85-acf3-073355c95d30`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:21:05,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:21:05,510::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-34::DEBUG::2014-08-21 10:21:05,525::task::595::TaskManager.Task::(_updateState) Task=`dbb0f1c8-fb64-486e-8b5a-d1124f70d436`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:21:05,527::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:21:05,529::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f5510d75-7854-401a-89ad-1944f143f520`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:21:05,530::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:21:05,531::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:21:05,532::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f5510d75-7854-401a-89ad-1944f143f520`::Granted request
>Thread-34::DEBUG::2014-08-21 10:21:05,534::task::827::TaskManager.Task::(resourceAcquired) Task=`dbb0f1c8-fb64-486e-8b5a-d1124f70d436`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:21:05,534::task::990::TaskManager.Task::(_decref) Task=`dbb0f1c8-fb64-486e-8b5a-d1124f70d436`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:21:05,542::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:21:05,543::task::1185::TaskManager.Task::(prepare) Task=`dbb0f1c8-fb64-486e-8b5a-d1124f70d436`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:21:05,543::task::595::TaskManager.Task::(_updateState) Task=`dbb0f1c8-fb64-486e-8b5a-d1124f70d436`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:21:05,544::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:21:05,544::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:21:05,546::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:21:05,546::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:21:05,547::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:21:05,548::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:21:05,549::task::990::TaskManager.Task::(_decref) Task=`dbb0f1c8-fb64-486e-8b5a-d1124f70d436`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:21:05,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0943299 s, 10.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:07,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:07,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0724157 s, 14.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:09,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:10,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474524 s, 21.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:12,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:21:15,815::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-13::DEBUG::2014-08-21 10:21:15,817::task::595::TaskManager.Task::(_updateState) Task=`358c0a19-cbbe-4569-886b-700949e3694b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:21:15,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:21:15,819::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:15,819::task::1185::TaskManager.Task::(prepare) Task=`358c0a19-cbbe-4569-886b-700949e3694b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:15,819::task::595::TaskManager.Task::(_updateState) Task=`358c0a19-cbbe-4569-886b-700949e3694b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:21:15,819::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:21:15,820::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:21:15,820::task::990::TaskManager.Task::(_decref) Task=`358c0a19-cbbe-4569-886b-700949e3694b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:21:15,828::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-34::DEBUG::2014-08-21 10:21:15,829::task::595::TaskManager.Task::(_updateState) Task=`dbf86d8a-e77d-40a6-9811-6e2a13acde26`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:21:15,829::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:21:15,830::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`94449041-3625-4010-96b5-f6dd5632ba96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:21:15,830::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:21:15,831::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:21:15,831::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`94449041-3625-4010-96b5-f6dd5632ba96`::Granted request
>Thread-34::DEBUG::2014-08-21 10:21:15,831::task::827::TaskManager.Task::(resourceAcquired) Task=`dbf86d8a-e77d-40a6-9811-6e2a13acde26`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:21:15,832::task::990::TaskManager.Task::(_decref) Task=`dbf86d8a-e77d-40a6-9811-6e2a13acde26`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:21:15,837::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:21:15,838::task::1185::TaskManager.Task::(prepare) Task=`dbf86d8a-e77d-40a6-9811-6e2a13acde26`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:21:15,838::task::595::TaskManager.Task::(_updateState) Task=`dbf86d8a-e77d-40a6-9811-6e2a13acde26`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:21:15,838::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:21:15,838::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:21:15,839::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:21:15,839::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:21:15,839::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:21:15,840::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:21:15,840::task::990::TaskManager.Task::(_decref) Task=`dbf86d8a-e77d-40a6-9811-6e2a13acde26`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:21:15,870::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:21:15,905::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000541 s, 921 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:16,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.22087 s, 318 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:18,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:21:24,619::task::595::TaskManager.Task::(_updateState) Task=`c8e0e8ec-9709-4b02-94de-a22e3ad9ffcb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:21:24,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:21:24,625::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:21:24,625::task::1185::TaskManager.Task::(prepare) Task=`c8e0e8ec-9709-4b02-94de-a22e3ad9ffcb`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:21:24,625::task::595::TaskManager.Task::(_updateState) Task=`c8e0e8ec-9709-4b02-94de-a22e3ad9ffcb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:21:24,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:21:24,626::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:21:24,626::task::990::TaskManager.Task::(_decref) Task=`c8e0e8ec-9709-4b02-94de-a22e3ad9ffcb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:21:25,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.26354 s, 810 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:21:25,883::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-13::DEBUG::2014-08-21 10:21:25,889::task::595::TaskManager.Task::(_updateState) Task=`e022e35c-7e49-4e09-9331-4c5b487bc7ac`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:21:25,893::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:21:25,898::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:25,900::task::1185::TaskManager.Task::(prepare) Task=`e022e35c-7e49-4e09-9331-4c5b487bc7ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:25,940::task::595::TaskManager.Task::(_updateState) Task=`e022e35c-7e49-4e09-9331-4c5b487bc7ac`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:21:25,942::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:21:25,946::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:21:25,958::task::990::TaskManager.Task::(_decref) Task=`e022e35c-7e49-4e09-9331-4c5b487bc7ac`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:21:26,051::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:21:26,062::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 10:21:26,063::task::595::TaskManager.Task::(_updateState) Task=`5d1acafb-9e79-456b-9436-149a8f2c49ba`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:21:26,064::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:21:26,065::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b5ef49c8-e589-4897-bca9-1e20db525c03`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:21:26,066::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:21:26,066::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:21:26,066::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b5ef49c8-e589-4897-bca9-1e20db525c03`::Granted request
>Thread-34::DEBUG::2014-08-21 10:21:26,067::task::827::TaskManager.Task::(resourceAcquired) Task=`5d1acafb-9e79-456b-9436-149a8f2c49ba`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:21:26,067::task::990::TaskManager.Task::(_decref) Task=`5d1acafb-9e79-456b-9436-149a8f2c49ba`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:21:26,073::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:21:26,073::task::1185::TaskManager.Task::(prepare) Task=`5d1acafb-9e79-456b-9436-149a8f2c49ba`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:21:26,074::task::595::TaskManager.Task::(_updateState) Task=`5d1acafb-9e79-456b-9436-149a8f2c49ba`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:21:26,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:21:26,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:21:26,075::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:21:26,075::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:21:26,076::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:21:26,076::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:21:26,076::task::990::TaskManager.Task::(_decref) Task=`5d1acafb-9e79-456b-9436-149a8f2c49ba`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:21:26,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000760648 s, 655 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:27,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:27,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530995 s, 19.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:30,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:30,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.268717 s, 3.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:32,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:32,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.206738 s, 5.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:34,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:21:39,220::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-13::DEBUG::2014-08-21 10:21:39,841::task::595::TaskManager.Task::(_updateState) Task=`02b278fa-1b0a-487b-9d49-1215fc70bd93`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:21:39,842::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:21:40,431::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:40,432::task::1185::TaskManager.Task::(prepare) Task=`02b278fa-1b0a-487b-9d49-1215fc70bd93`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:40,433::task::595::TaskManager.Task::(_updateState) Task=`02b278fa-1b0a-487b-9d49-1215fc70bd93`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:21:40,939::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:21:40,940::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:21:40,941::task::990::TaskManager.Task::(_decref) Task=`02b278fa-1b0a-487b-9d49-1215fc70bd93`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:21:41,722::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-34::DEBUG::2014-08-21 10:21:41,927::task::595::TaskManager.Task::(_updateState) Task=`98be5180-573e-4fda-baa3-be81c747efb4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:21:41,928::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:21:41,929::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2440da59-d208-4c34-b6f4-f46b580ac588`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:21:41,929::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:21:41,930::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:21:41,961::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2440da59-d208-4c34-b6f4-f46b580ac588`::Granted request
>Thread-34::DEBUG::2014-08-21 10:21:41,963::task::827::TaskManager.Task::(resourceAcquired) Task=`98be5180-573e-4fda-baa3-be81c747efb4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:21:41,963::task::990::TaskManager.Task::(_decref) Task=`98be5180-573e-4fda-baa3-be81c747efb4`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:21:41,961::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:21:42,336::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-15::DEBUG::2014-08-21 10:21:42,334::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000457503 s, 1.1 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:21:42,342::task::1185::TaskManager.Task::(prepare) Task=`98be5180-573e-4fda-baa3-be81c747efb4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:21:42,351::task::595::TaskManager.Task::(_updateState) Task=`98be5180-573e-4fda-baa3-be81c747efb4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:21:42,357::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:21:42,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:21:42,389::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:21:42,394::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:21:42,400::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:21:42,403::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:21:42,410::task::990::TaskManager.Task::(_decref) Task=`98be5180-573e-4fda-baa3-be81c747efb4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:21:42,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.15503 s, 143 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:21:44,071::task::595::TaskManager.Task::(_updateState) Task=`c23bc0c8-8794-4927-be0f-12b5f3152c03`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:21:44,072::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:21:44,099::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457503', 'lastCheck': '1.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:21:44,100::task::1185::TaskManager.Task::(prepare) Task=`c23bc0c8-8794-4927-be0f-12b5f3152c03`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457503', 'lastCheck': '1.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:21:44,101::task::595::TaskManager.Task::(_updateState) Task=`c23bc0c8-8794-4927-be0f-12b5f3152c03`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:21:44,101::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:21:44,101::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:21:44,202::task::990::TaskManager.Task::(_decref) Task=`c23bc0c8-8794-4927-be0f-12b5f3152c03`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:21:44,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:46,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.19523 s, 857 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:48,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:48,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455926 s, 22.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:50,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:50,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119584 s, 8.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:21:52,449::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-13::DEBUG::2014-08-21 10:21:52,450::task::595::TaskManager.Task::(_updateState) Task=`9ada6f07-ff0d-4d53-a780-0463856bc933`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:21:52,451::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:21:52,452::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:52,452::task::1185::TaskManager.Task::(prepare) Task=`9ada6f07-ff0d-4d53-a780-0463856bc933`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:21:52,453::task::595::TaskManager.Task::(_updateState) Task=`9ada6f07-ff0d-4d53-a780-0463856bc933`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:21:52,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:21:52,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:21:52,454::task::990::TaskManager.Task::(_decref) Task=`9ada6f07-ff0d-4d53-a780-0463856bc933`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:21:52,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:21:52,499::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-34::DEBUG::2014-08-21 10:21:52,501::task::595::TaskManager.Task::(_updateState) Task=`4144bd88-50ff-407a-8559-bb21d3f5168b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:21:52,534::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:21:52,536::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e182ce3e-0b0b-4d0d-9f60-06a8cead8fa6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:21:52,536::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:21:52,537::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:21:52,538::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e182ce3e-0b0b-4d0d-9f60-06a8cead8fa6`::Granted request
>Dummy-33::DEBUG::2014-08-21 10:21:52,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:21:52,783::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.029871 s, 16.7 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:21:52,921::task::827::TaskManager.Task::(resourceAcquired) Task=`4144bd88-50ff-407a-8559-bb21d3f5168b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:21:52,939::task::990::TaskManager.Task::(_decref) Task=`4144bd88-50ff-407a-8559-bb21d3f5168b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:21:53,055::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:21:53,064::task::1185::TaskManager.Task::(prepare) Task=`4144bd88-50ff-407a-8559-bb21d3f5168b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:21:53,068::task::595::TaskManager.Task::(_updateState) Task=`4144bd88-50ff-407a-8559-bb21d3f5168b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:21:53,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:21:53,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:21:53,078::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:21:53,082::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:21:53,083::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:21:53,085::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:21:53,090::task::990::TaskManager.Task::(_decref) Task=`4144bd88-50ff-407a-8559-bb21d3f5168b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:21:53,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.610732 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:55,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:55,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.223965 s, 4.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:21:58,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:21:58,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.299539 s, 3.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:21:59,620::task::595::TaskManager.Task::(_updateState) Task=`35e810ea-b246-48c4-90e8-174d84d13d10`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:21:59,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:21:59,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.029871', 'lastCheck': '6.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:21:59,622::task::1185::TaskManager.Task::(prepare) Task=`35e810ea-b246-48c4-90e8-174d84d13d10`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.029871', 'lastCheck': '6.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:21:59,622::task::595::TaskManager.Task::(_updateState) Task=`35e810ea-b246-48c4-90e8-174d84d13d10`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:21:59,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:21:59,623::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:21:59,623::task::990::TaskManager.Task::(_decref) Task=`35e810ea-b246-48c4-90e8-174d84d13d10`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:22:01,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:01,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.187491 s, 5.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:22:03,016::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:22:03,034::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00134356 s, 371 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:22:03,132::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-13::DEBUG::2014-08-21 10:22:03,134::task::595::TaskManager.Task::(_updateState) Task=`131a1490-0da5-4bb2-b445-0f2219c72185`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:22:03,134::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:22:03,135::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:03,135::task::1185::TaskManager.Task::(prepare) Task=`131a1490-0da5-4bb2-b445-0f2219c72185`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:03,136::task::595::TaskManager.Task::(_updateState) Task=`131a1490-0da5-4bb2-b445-0f2219c72185`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:22:03,136::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:22:03,137::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:22:03,137::task::990::TaskManager.Task::(_decref) Task=`131a1490-0da5-4bb2-b445-0f2219c72185`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:22:03,142::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-34::DEBUG::2014-08-21 10:22:03,144::task::595::TaskManager.Task::(_updateState) Task=`490e8fa0-26fc-444f-b5ef-1784f4ba5e2e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:22:03,144::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:22:03,145::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eb16ad7e-9d92-4689-8e09-187c0de3ec97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:22:03,146::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:22:03,146::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:22:03,147::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eb16ad7e-9d92-4689-8e09-187c0de3ec97`::Granted request
>Thread-34::DEBUG::2014-08-21 10:22:03,148::task::827::TaskManager.Task::(resourceAcquired) Task=`490e8fa0-26fc-444f-b5ef-1784f4ba5e2e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:22:03,148::task::990::TaskManager.Task::(_decref) Task=`490e8fa0-26fc-444f-b5ef-1784f4ba5e2e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:22:03,155::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:03,156::task::1185::TaskManager.Task::(prepare) Task=`490e8fa0-26fc-444f-b5ef-1784f4ba5e2e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:03,156::task::595::TaskManager.Task::(_updateState) Task=`490e8fa0-26fc-444f-b5ef-1784f4ba5e2e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:22:03,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:22:03,157::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:22:03,157::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:22:03,158::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:22:03,158::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:22:03,159::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:22:03,159::task::990::TaskManager.Task::(_decref) Task=`490e8fa0-26fc-444f-b5ef-1784f4ba5e2e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:22:03,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:03,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439053 s, 23.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:05,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:05,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0760089 s, 13.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:07,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:08,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.200048 s, 5.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:10,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:10,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0834027 s, 12.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:12,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:12,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0547939 s, 18.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:22:13,065::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:22:13,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000506389 s, 983 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:22:13,180::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-13::DEBUG::2014-08-21 10:22:13,182::task::595::TaskManager.Task::(_updateState) Task=`4aa4043f-7af1-4517-b148-fa7f61ce807e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:22:13,183::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:22:13,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:13,184::task::1185::TaskManager.Task::(prepare) Task=`4aa4043f-7af1-4517-b148-fa7f61ce807e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:13,185::task::595::TaskManager.Task::(_updateState) Task=`4aa4043f-7af1-4517-b148-fa7f61ce807e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:22:13,185::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:22:13,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:22:13,186::task::990::TaskManager.Task::(_decref) Task=`4aa4043f-7af1-4517-b148-fa7f61ce807e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:22:13,191::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 10:22:13,192::task::595::TaskManager.Task::(_updateState) Task=`86863787-f733-448e-8bbb-2b4dd53db24e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:22:13,192::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:22:13,193::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a9dcfdd7-8189-43eb-8833-6a5e4a041334`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:22:13,193::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:22:13,193::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:22:13,194::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a9dcfdd7-8189-43eb-8833-6a5e4a041334`::Granted request
>Thread-34::DEBUG::2014-08-21 10:22:13,194::task::827::TaskManager.Task::(resourceAcquired) Task=`86863787-f733-448e-8bbb-2b4dd53db24e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:22:13,195::task::990::TaskManager.Task::(_decref) Task=`86863787-f733-448e-8bbb-2b4dd53db24e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:22:13,198::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:13,199::task::1185::TaskManager.Task::(prepare) Task=`86863787-f733-448e-8bbb-2b4dd53db24e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:13,199::task::595::TaskManager.Task::(_updateState) Task=`86863787-f733-448e-8bbb-2b4dd53db24e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:22:13,199::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:22:13,199::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:22:13,199::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:22:13,200::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:22:13,200::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:22:13,200::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:22:13,200::task::990::TaskManager.Task::(_decref) Task=`86863787-f733-448e-8bbb-2b4dd53db24e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:22:14,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:22:14,816::task::595::TaskManager.Task::(_updateState) Task=`035400a4-eac4-4023-8af8-8b696e3e9ba3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:22:14,817::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:22:14,817::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506389', 'lastCheck': '1.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:22:14,818::task::1185::TaskManager.Task::(prepare) Task=`035400a4-eac4-4023-8af8-8b696e3e9ba3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506389', 'lastCheck': '1.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:22:14,818::task::595::TaskManager.Task::(_updateState) Task=`035400a4-eac4-4023-8af8-8b696e3e9ba3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:22:14,819::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:22:14,819::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:22:14,820::task::990::TaskManager.Task::(_decref) Task=`035400a4-eac4-4023-8af8-8b696e3e9ba3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:22:14,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.127782 s, 8.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:16,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:20,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.21946 s, 840 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:22,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:22:23,903::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [464d05c]
>Thread-13::DEBUG::2014-08-21 10:22:23,911::task::595::TaskManager.Task::(_updateState) Task=`76feaea9-6198-48ca-81b3-ff3067a5df9e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:22:23,914::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:22:23,921::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:23,924::task::1185::TaskManager.Task::(prepare) Task=`76feaea9-6198-48ca-81b3-ff3067a5df9e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:23,927::task::595::TaskManager.Task::(_updateState) Task=`76feaea9-6198-48ca-81b3-ff3067a5df9e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:22:23,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:22:23,934::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:22:23,938::task::990::TaskManager.Task::(_decref) Task=`76feaea9-6198-48ca-81b3-ff3067a5df9e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:22:23,965::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [464d05c]
>Thread-34::DEBUG::2014-08-21 10:22:23,973::task::595::TaskManager.Task::(_updateState) Task=`0fc8e16c-015e-4853-bb24-9446bbe1a030`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:22:23,979::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:22:23,993::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e9e9dd73-cc5d-440c-bfb3-5f61f5d66b84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:22:24,000::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:22:24,010::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:22:24,016::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e9e9dd73-cc5d-440c-bfb3-5f61f5d66b84`::Granted request
>Thread-34::DEBUG::2014-08-21 10:22:24,027::task::827::TaskManager.Task::(resourceAcquired) Task=`0fc8e16c-015e-4853-bb24-9446bbe1a030`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:22:24,033::task::990::TaskManager.Task::(_decref) Task=`0fc8e16c-015e-4853-bb24-9446bbe1a030`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:22:24,056::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:22:24,124::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00100878 s, 494 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:22:24,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:24,160::task::1185::TaskManager.Task::(prepare) Task=`0fc8e16c-015e-4853-bb24-9446bbe1a030`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:24,166::task::595::TaskManager.Task::(_updateState) Task=`0fc8e16c-015e-4853-bb24-9446bbe1a030`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:22:24,171::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:22:24,176::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:22:24,184::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:22:24,189::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:22:24,191::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:22:24,193::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:22:24,196::task::990::TaskManager.Task::(_decref) Task=`0fc8e16c-015e-4853-bb24-9446bbe1a030`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:22:24,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.61543 s, 634 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:26,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:26,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0686576 s, 14.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:28,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:29,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.336878 s, 3.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:22:30,192::task::595::TaskManager.Task::(_updateState) Task=`d4aaf778-68fe-431d-b9b1-7ad254712b19`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:22:30,193::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:22:30,195::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100878', 'lastCheck': '6.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:22:30,195::task::1185::TaskManager.Task::(prepare) Task=`d4aaf778-68fe-431d-b9b1-7ad254712b19`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100878', 'lastCheck': '6.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:22:30,195::task::595::TaskManager.Task::(_updateState) Task=`d4aaf778-68fe-431d-b9b1-7ad254712b19`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:22:30,196::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:22:30,196::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:22:30,196::task::990::TaskManager.Task::(_decref) Task=`d4aaf778-68fe-431d-b9b1-7ad254712b19`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:22:31,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:32,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.317981 s, 3.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:22:34,202::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:22:34,223::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-13::DEBUG::2014-08-21 10:22:34,224::task::595::TaskManager.Task::(_updateState) Task=`5a7b8824-4088-4046-803a-6d7ce10670ed`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:22:34,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:22:34,225::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:34,225::task::1185::TaskManager.Task::(prepare) Task=`5a7b8824-4088-4046-803a-6d7ce10670ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:34,226::task::595::TaskManager.Task::(_updateState) Task=`5a7b8824-4088-4046-803a-6d7ce10670ed`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:22:34,226::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:22:34,226::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:22:34,226::task::990::TaskManager.Task::(_decref) Task=`5a7b8824-4088-4046-803a-6d7ce10670ed`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:22:34,248::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 10:22:34,249::task::595::TaskManager.Task::(_updateState) Task=`9af73e25-8c43-4292-9e94-1891120fbb20`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:22:34,250::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:22:34,251::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4212b57a-4b80-4ba2-9539-3312e445133f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:22:34,251::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:22:34,252::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:22:34,255::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4212b57a-4b80-4ba2-9539-3312e445133f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:22:34,267::task::827::TaskManager.Task::(resourceAcquired) Task=`9af73e25-8c43-4292-9e94-1891120fbb20`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:22:34,270::task::990::TaskManager.Task::(_decref) Task=`9af73e25-8c43-4292-9e94-1891120fbb20`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:22:34,304::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00111454 s, 447 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:22:34,332::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:34,336::task::1185::TaskManager.Task::(prepare) Task=`9af73e25-8c43-4292-9e94-1891120fbb20`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:34,339::task::595::TaskManager.Task::(_updateState) Task=`9af73e25-8c43-4292-9e94-1891120fbb20`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:22:34,341::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:22:34,342::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:22:34,343::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:22:34,345::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:22:34,347::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:22:34,348::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:22:34,351::task::990::TaskManager.Task::(_decref) Task=`9af73e25-8c43-4292-9e94-1891120fbb20`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:22:34,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:34,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.162403 s, 6.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:36,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:36,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0921001 s, 11.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:38,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:39,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111715 s, 9.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:41,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:41,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.27127 s, 3.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:43,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:43,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0583974 s, 17.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:22:44,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:22:44,377::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-13::DEBUG::2014-08-21 10:22:44,383::task::595::TaskManager.Task::(_updateState) Task=`5bcb4a9c-5e11-4168-8068-c9d0076ca80d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:22:44,385::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:22:44,392::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-15::DEBUG::2014-08-21 10:22:44,405::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00256523 s, 194 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:22:44,406::task::1185::TaskManager.Task::(prepare) Task=`5bcb4a9c-5e11-4168-8068-c9d0076ca80d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:44,409::task::595::TaskManager.Task::(_updateState) Task=`5bcb4a9c-5e11-4168-8068-c9d0076ca80d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:22:44,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:22:44,414::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:22:44,417::task::990::TaskManager.Task::(_decref) Task=`5bcb4a9c-5e11-4168-8068-c9d0076ca80d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:22:44,433::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 10:22:44,436::task::595::TaskManager.Task::(_updateState) Task=`744c84aa-2113-40fe-ad77-14602b3776a7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:22:44,438::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:22:44,444::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ec6287c0-5be9-4fb2-bd3e-3c0e247a979b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:22:44,445::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:22:44,449::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:22:44,451::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ec6287c0-5be9-4fb2-bd3e-3c0e247a979b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:22:44,455::task::827::TaskManager.Task::(resourceAcquired) Task=`744c84aa-2113-40fe-ad77-14602b3776a7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:22:44,457::task::990::TaskManager.Task::(_decref) Task=`744c84aa-2113-40fe-ad77-14602b3776a7`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:22:44,492::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:44,494::task::1185::TaskManager.Task::(prepare) Task=`744c84aa-2113-40fe-ad77-14602b3776a7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:44,495::task::595::TaskManager.Task::(_updateState) Task=`744c84aa-2113-40fe-ad77-14602b3776a7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:22:44,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:22:44,499::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:22:44,503::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:22:44,506::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:22:44,508::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:22:44,510::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:22:44,514::task::990::TaskManager.Task::(_decref) Task=`744c84aa-2113-40fe-ad77-14602b3776a7`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:22:45,329::task::595::TaskManager.Task::(_updateState) Task=`625decc2-e2bc-439e-8a2c-4e94518e6b16`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:22:45,330::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:22:45,330::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00256523', 'lastCheck': '0.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:22:45,330::task::1185::TaskManager.Task::(prepare) Task=`625decc2-e2bc-439e-8a2c-4e94518e6b16`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00256523', 'lastCheck': '0.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:22:45,330::task::595::TaskManager.Task::(_updateState) Task=`625decc2-e2bc-439e-8a2c-4e94518e6b16`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:22:45,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:22:45,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:22:45,331::task::990::TaskManager.Task::(_decref) Task=`625decc2-e2bc-439e-8a2c-4e94518e6b16`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:22:45,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:50,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.52274 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:52,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:54,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.82497 s, 561 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:22:54,460::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:22:54,475::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000956744 s, 521 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:22:54,564::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-13::DEBUG::2014-08-21 10:22:54,568::task::595::TaskManager.Task::(_updateState) Task=`30340fab-0c0a-40c0-8a00-2a2c39138f6c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:22:54,570::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:22:54,572::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:54,573::task::1185::TaskManager.Task::(prepare) Task=`30340fab-0c0a-40c0-8a00-2a2c39138f6c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:22:54,575::task::595::TaskManager.Task::(_updateState) Task=`30340fab-0c0a-40c0-8a00-2a2c39138f6c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:22:54,576::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:22:54,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:22:54,579::task::990::TaskManager.Task::(_decref) Task=`30340fab-0c0a-40c0-8a00-2a2c39138f6c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:22:54,590::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 10:22:54,592::task::595::TaskManager.Task::(_updateState) Task=`64177bc7-c4b4-4063-af65-b98eefa65350`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:22:54,594::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:22:54,597::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1714f346-71c9-4c29-a14e-5bc4f8be609d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:22:54,598::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:22:54,606::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:22:54,608::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1714f346-71c9-4c29-a14e-5bc4f8be609d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:22:54,610::task::827::TaskManager.Task::(resourceAcquired) Task=`64177bc7-c4b4-4063-af65-b98eefa65350`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:22:54,612::task::990::TaskManager.Task::(_decref) Task=`64177bc7-c4b4-4063-af65-b98eefa65350`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:22:54,638::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:54,640::task::1185::TaskManager.Task::(prepare) Task=`64177bc7-c4b4-4063-af65-b98eefa65350`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:22:54,641::task::595::TaskManager.Task::(_updateState) Task=`64177bc7-c4b4-4063-af65-b98eefa65350`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:22:54,642::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:22:54,643::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:22:54,645::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:22:54,647::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:22:54,648::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:22:54,649::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:22:54,651::task::990::TaskManager.Task::(_decref) Task=`64177bc7-c4b4-4063-af65-b98eefa65350`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:22:56,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:56,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0981762 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:22:58,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:22:58,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0680505 s, 15.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:00,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:00,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0893752 s, 11.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:02,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:02,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0764169 s, 13.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:23:03,067::task::595::TaskManager.Task::(_updateState) Task=`52291d7f-86d1-4dca-84a8-8b7190a26cd6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:03,068::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:23:03,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000956744', 'lastCheck': '8.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:23:03,069::task::1185::TaskManager.Task::(prepare) Task=`52291d7f-86d1-4dca-84a8-8b7190a26cd6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000956744', 'lastCheck': '8.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:23:03,069::task::595::TaskManager.Task::(_updateState) Task=`52291d7f-86d1-4dca-84a8-8b7190a26cd6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:03,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:03,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:03,071::task::990::TaskManager.Task::(_decref) Task=`52291d7f-86d1-4dca-84a8-8b7190a26cd6`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:23:04,509::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:23:04,585::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0135311 s, 36.8 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:23:04,700::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-13::DEBUG::2014-08-21 10:23:04,701::task::595::TaskManager.Task::(_updateState) Task=`0485c530-92b3-4eab-92b3-b471e70e8720`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:04,702::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:23:04,724::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:04,725::task::1185::TaskManager.Task::(prepare) Task=`0485c530-92b3-4eab-92b3-b471e70e8720`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:04,731::task::595::TaskManager.Task::(_updateState) Task=`0485c530-92b3-4eab-92b3-b471e70e8720`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:04,739::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:04,940::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:04,949::task::990::TaskManager.Task::(_decref) Task=`0485c530-92b3-4eab-92b3-b471e70e8720`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:23:04,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:23:05,588::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 10:23:05,736::task::595::TaskManager.Task::(_updateState) Task=`d34c971b-4d13-45b5-b44c-2cfe7fba490c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:23:05,755::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:23:05,756::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`280f3e51-2bb7-4d73-bcb1-adcdb268e46d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:23:05,764::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:23:05,810::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:23:05,811::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`280f3e51-2bb7-4d73-bcb1-adcdb268e46d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:23:05,938::task::827::TaskManager.Task::(resourceAcquired) Task=`d34c971b-4d13-45b5-b44c-2cfe7fba490c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:23:06,630::task::990::TaskManager.Task::(_decref) Task=`d34c971b-4d13-45b5-b44c-2cfe7fba490c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:23:07,244::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:07,246::task::1185::TaskManager.Task::(prepare) Task=`d34c971b-4d13-45b5-b44c-2cfe7fba490c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:07,247::task::595::TaskManager.Task::(_updateState) Task=`d34c971b-4d13-45b5-b44c-2cfe7fba490c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:23:07,248::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:23:07,249::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:23:07,251::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:23:07,252::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:23:07,253::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:23:07,254::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:23:07,256::task::990::TaskManager.Task::(_decref) Task=`d34c971b-4d13-45b5-b44c-2cfe7fba490c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:23:07,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.94156 s, 527 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:09,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:12,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.85966 s, 358 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:14,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:23:14,668::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:23:14,719::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:23:14,726::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:23:14,754::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:23:14,761::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:23:14,762::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:23:14,763::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 10:23:14,823::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:23:14,864::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00393592 s, 127 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:14,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.230094 s, 4.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:16,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:23:18,066::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-13::DEBUG::2014-08-21 10:23:18,089::task::595::TaskManager.Task::(_updateState) Task=`1a13e198-db01-4ddf-b27d-3501252f0d15`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:18,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:23:18,107::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:18,110::task::1185::TaskManager.Task::(prepare) Task=`1a13e198-db01-4ddf-b27d-3501252f0d15`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:18,113::task::595::TaskManager.Task::(_updateState) Task=`1a13e198-db01-4ddf-b27d-3501252f0d15`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:18,115::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:18,117::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:18,119::task::990::TaskManager.Task::(_decref) Task=`1a13e198-db01-4ddf-b27d-3501252f0d15`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:23:18,138::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-34::DEBUG::2014-08-21 10:23:18,142::task::595::TaskManager.Task::(_updateState) Task=`c7b78f24-b0ba-441b-9d65-0e372fba38ae`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:23:18,145::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:23:18,150::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`66b28aad-1d0f-42a8-bd93-0ce2403ac5d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:23:18,152::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:23:18,153::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:23:18,154::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`66b28aad-1d0f-42a8-bd93-0ce2403ac5d9`::Granted request
>Thread-34::DEBUG::2014-08-21 10:23:18,156::task::827::TaskManager.Task::(resourceAcquired) Task=`c7b78f24-b0ba-441b-9d65-0e372fba38ae`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:23:18,157::task::990::TaskManager.Task::(_decref) Task=`c7b78f24-b0ba-441b-9d65-0e372fba38ae`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:23:18,178::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:18,180::task::1185::TaskManager.Task::(prepare) Task=`c7b78f24-b0ba-441b-9d65-0e372fba38ae`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:18,182::task::595::TaskManager.Task::(_updateState) Task=`c7b78f24-b0ba-441b-9d65-0e372fba38ae`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:23:18,184::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:23:18,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:23:18,187::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:23:18,190::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:23:18,191::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:23:18,191::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:23:18,192::task::990::TaskManager.Task::(_decref) Task=`c7b78f24-b0ba-441b-9d65-0e372fba38ae`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:23:18,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.1773 s, 870 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:23:19,394::task::595::TaskManager.Task::(_updateState) Task=`bcaf307f-cff4-44b1-b014-c82a2b804690`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:19,395::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:23:19,395::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00393592', 'lastCheck': '4.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:23:19,396::task::1185::TaskManager.Task::(prepare) Task=`bcaf307f-cff4-44b1-b014-c82a2b804690`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00393592', 'lastCheck': '4.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:23:19,396::task::595::TaskManager.Task::(_updateState) Task=`bcaf307f-cff4-44b1-b014-c82a2b804690`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:19,396::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:19,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:19,397::task::990::TaskManager.Task::(_decref) Task=`bcaf307f-cff4-44b1-b014-c82a2b804690`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:23:20,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:20,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0478778 s, 21.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:22,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:22,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0728961 s, 14.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:24,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:24,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0503052 s, 20.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:23:24,925::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:23:24,947::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000711453 s, 700 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:26,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:27,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0598238 s, 17.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:23:28,224::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-13::DEBUG::2014-08-21 10:23:28,227::task::595::TaskManager.Task::(_updateState) Task=`69539cab-1e63-4efa-9a4d-fee90f3a5e25`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:28,228::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:23:28,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:28,229::task::1185::TaskManager.Task::(prepare) Task=`69539cab-1e63-4efa-9a4d-fee90f3a5e25`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:28,229::task::595::TaskManager.Task::(_updateState) Task=`69539cab-1e63-4efa-9a4d-fee90f3a5e25`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:28,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:28,229::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:28,230::task::990::TaskManager.Task::(_decref) Task=`69539cab-1e63-4efa-9a4d-fee90f3a5e25`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:23:28,263::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-34::DEBUG::2014-08-21 10:23:28,265::task::595::TaskManager.Task::(_updateState) Task=`b4abfc78-db75-487b-9ac7-bfaff023fb42`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:23:28,265::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:23:28,266::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f69f862c-b30e-4e4a-9af9-dfccbe91035c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:23:28,266::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:23:28,267::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:23:28,267::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f69f862c-b30e-4e4a-9af9-dfccbe91035c`::Granted request
>Thread-34::DEBUG::2014-08-21 10:23:28,268::task::827::TaskManager.Task::(resourceAcquired) Task=`b4abfc78-db75-487b-9ac7-bfaff023fb42`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:23:28,268::task::990::TaskManager.Task::(_decref) Task=`b4abfc78-db75-487b-9ac7-bfaff023fb42`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:23:28,274::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:28,275::task::1185::TaskManager.Task::(prepare) Task=`b4abfc78-db75-487b-9ac7-bfaff023fb42`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:28,275::task::595::TaskManager.Task::(_updateState) Task=`b4abfc78-db75-487b-9ac7-bfaff023fb42`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:23:28,275::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:23:28,276::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:23:28,276::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:23:28,281::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:23:28,282::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:23:28,282::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:23:28,282::task::990::TaskManager.Task::(_decref) Task=`b4abfc78-db75-487b-9ac7-bfaff023fb42`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:23:29,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:29,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.236938 s, 4.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:31,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:31,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414727 s, 24.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:33,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:34,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.274609 s, 3.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:23:34,688::task::595::TaskManager.Task::(_updateState) Task=`80368d77-4c94-478f-b230-b7a00f0a8e8c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:34,689::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:23:34,689::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711453', 'lastCheck': '9.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:23:34,690::task::1185::TaskManager.Task::(prepare) Task=`80368d77-4c94-478f-b230-b7a00f0a8e8c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711453', 'lastCheck': '9.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:23:34,690::task::595::TaskManager.Task::(_updateState) Task=`80368d77-4c94-478f-b230-b7a00f0a8e8c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:34,690::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:34,691::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:34,691::task::990::TaskManager.Task::(_decref) Task=`80368d77-4c94-478f-b230-b7a00f0a8e8c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:23:34,979::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:23:34,997::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000680411 s, 732 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:36,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:36,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.139841 s, 7.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:38,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:23:38,304::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-13::DEBUG::2014-08-21 10:23:38,305::task::595::TaskManager.Task::(_updateState) Task=`d0383041-a2b5-4d0b-9cd1-2877c18bd123`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:38,305::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:23:38,306::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:38,306::task::1185::TaskManager.Task::(prepare) Task=`d0383041-a2b5-4d0b-9cd1-2877c18bd123`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:38,306::task::595::TaskManager.Task::(_updateState) Task=`d0383041-a2b5-4d0b-9cd1-2877c18bd123`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:38,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:38,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:38,307::task::990::TaskManager.Task::(_decref) Task=`d0383041-a2b5-4d0b-9cd1-2877c18bd123`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:23:38,312::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-34::DEBUG::2014-08-21 10:23:38,312::task::595::TaskManager.Task::(_updateState) Task=`e35c3db7-bfa5-4d5c-85f1-5b9ae97cb581`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:23:38,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:23:38,313::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d193ecc4-5666-41e2-bee4-8cd833c57446`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:23:38,313::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:23:38,314::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:23:38,314::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d193ecc4-5666-41e2-bee4-8cd833c57446`::Granted request
>Thread-34::DEBUG::2014-08-21 10:23:38,317::task::827::TaskManager.Task::(resourceAcquired) Task=`e35c3db7-bfa5-4d5c-85f1-5b9ae97cb581`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:23:38,317::task::990::TaskManager.Task::(_decref) Task=`e35c3db7-bfa5-4d5c-85f1-5b9ae97cb581`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:23:38,321::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:38,321::task::1185::TaskManager.Task::(prepare) Task=`e35c3db7-bfa5-4d5c-85f1-5b9ae97cb581`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:38,321::task::595::TaskManager.Task::(_updateState) Task=`e35c3db7-bfa5-4d5c-85f1-5b9ae97cb581`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:23:38,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:23:38,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:23:38,322::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:23:38,322::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:23:38,323::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:23:38,323::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:23:38,323::task::990::TaskManager.Task::(_decref) Task=`e35c3db7-bfa5-4d5c-85f1-5b9ae97cb581`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:23:38,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.180992 s, 5.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:40,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:40,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.15145 s, 6.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:43,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:44,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.24384 s, 823 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:23:45,015::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:23:45,031::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000467843 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:46,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:46,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0996564 s, 10.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:23:48,343::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-13::DEBUG::2014-08-21 10:23:48,345::task::595::TaskManager.Task::(_updateState) Task=`926b1f19-6e07-4110-814a-b67bb3dda453`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:48,345::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:23:48,346::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:48,346::task::1185::TaskManager.Task::(prepare) Task=`926b1f19-6e07-4110-814a-b67bb3dda453`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:48,346::task::595::TaskManager.Task::(_updateState) Task=`926b1f19-6e07-4110-814a-b67bb3dda453`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:48,346::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:48,346::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:48,346::task::990::TaskManager.Task::(_decref) Task=`926b1f19-6e07-4110-814a-b67bb3dda453`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:23:48,351::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-34::DEBUG::2014-08-21 10:23:48,351::task::595::TaskManager.Task::(_updateState) Task=`1d8c327b-a554-448e-9e75-0ad632b399fd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:23:48,351::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:23:48,352::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3a3a5655-4c9b-42e3-b8ad-f9e5d9c11072`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:23:48,352::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:23:48,352::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:23:48,352::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3a3a5655-4c9b-42e3-b8ad-f9e5d9c11072`::Granted request
>Thread-34::DEBUG::2014-08-21 10:23:48,353::task::827::TaskManager.Task::(resourceAcquired) Task=`1d8c327b-a554-448e-9e75-0ad632b399fd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:23:48,353::task::990::TaskManager.Task::(_decref) Task=`1d8c327b-a554-448e-9e75-0ad632b399fd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:23:48,356::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:48,357::task::1185::TaskManager.Task::(prepare) Task=`1d8c327b-a554-448e-9e75-0ad632b399fd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:48,357::task::595::TaskManager.Task::(_updateState) Task=`1d8c327b-a554-448e-9e75-0ad632b399fd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:23:48,357::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:23:48,357::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:23:48,357::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:23:48,358::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:23:48,358::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:23:48,358::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:23:48,358::task::990::TaskManager.Task::(_decref) Task=`1d8c327b-a554-448e-9e75-0ad632b399fd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:23:48,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:48,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170597 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:50,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:23:51,084::task::595::TaskManager.Task::(_updateState) Task=`7a0d685e-04fd-4ecb-9bdb-30166a1ebfa7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:51,089::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:23:51,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467843', 'lastCheck': '6.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:23:51,265::task::1185::TaskManager.Task::(prepare) Task=`7a0d685e-04fd-4ecb-9bdb-30166a1ebfa7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467843', 'lastCheck': '6.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:23:51,571::task::595::TaskManager.Task::(_updateState) Task=`7a0d685e-04fd-4ecb-9bdb-30166a1ebfa7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:51,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:51,757::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:51,758::task::990::TaskManager.Task::(_decref) Task=`7a0d685e-04fd-4ecb-9bdb-30166a1ebfa7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:23:53,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.48095 s, 691 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:23:55,067::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:23:55,084::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00123291 s, 404 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:55,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:55,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.140676 s, 7.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:23:57,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:23:57,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0808537 s, 12.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:23:58,382::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Thread-13::DEBUG::2014-08-21 10:23:58,384::task::595::TaskManager.Task::(_updateState) Task=`b14f4b00-9c80-474c-ac8c-6b471cd50b26`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:23:58,385::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:23:58,385::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:58,386::task::1185::TaskManager.Task::(prepare) Task=`b14f4b00-9c80-474c-ac8c-6b471cd50b26`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:23:58,386::task::595::TaskManager.Task::(_updateState) Task=`b14f4b00-9c80-474c-ac8c-6b471cd50b26`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:23:58,386::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:23:58,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:23:58,387::task::990::TaskManager.Task::(_decref) Task=`b14f4b00-9c80-474c-ac8c-6b471cd50b26`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:23:58,393::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Thread-34::DEBUG::2014-08-21 10:23:58,393::task::595::TaskManager.Task::(_updateState) Task=`7d398655-7d74-4497-b5a8-1073c9988d3c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:23:58,393::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:23:58,394::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9ad5245f-787d-4f47-8394-ae4fd16919e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:23:58,394::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:23:58,395::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:23:58,395::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9ad5245f-787d-4f47-8394-ae4fd16919e5`::Granted request
>Thread-34::DEBUG::2014-08-21 10:23:58,395::task::827::TaskManager.Task::(resourceAcquired) Task=`7d398655-7d74-4497-b5a8-1073c9988d3c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:23:58,396::task::990::TaskManager.Task::(_decref) Task=`7d398655-7d74-4497-b5a8-1073c9988d3c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:23:58,400::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:58,400::task::1185::TaskManager.Task::(prepare) Task=`7d398655-7d74-4497-b5a8-1073c9988d3c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:23:58,400::task::595::TaskManager.Task::(_updateState) Task=`7d398655-7d74-4497-b5a8-1073c9988d3c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:23:58,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:23:58,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:23:58,401::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:23:58,402::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:23:58,402::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:23:58,402::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:23:58,402::task::990::TaskManager.Task::(_decref) Task=`7d398655-7d74-4497-b5a8-1073c9988d3c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:23:59,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:00,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0665147 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:02,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:02,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.28596 s, 3.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:04,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:24:05,159::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:24:05,292::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000699313 s, 712 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:05,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.204334 s, 5.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:07,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:07,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0790959 s, 12.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:24:07,990::task::595::TaskManager.Task::(_updateState) Task=`0e146f51-e99b-41cf-98df-13a6448b0efe`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:24:07,991::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:24:07,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699313', 'lastCheck': '2.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:24:07,992::task::1185::TaskManager.Task::(prepare) Task=`0e146f51-e99b-41cf-98df-13a6448b0efe`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699313', 'lastCheck': '2.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:24:07,992::task::595::TaskManager.Task::(_updateState) Task=`0e146f51-e99b-41cf-98df-13a6448b0efe`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:24:07,993::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:24:07,993::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:24:07,993::task::990::TaskManager.Task::(_decref) Task=`0e146f51-e99b-41cf-98df-13a6448b0efe`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:24:08,421::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-13::DEBUG::2014-08-21 10:24:08,422::task::595::TaskManager.Task::(_updateState) Task=`1f40a92c-1d7f-4c26-aec6-050f99d5b409`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:24:08,423::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:24:08,424::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:24:08,424::task::1185::TaskManager.Task::(prepare) Task=`1f40a92c-1d7f-4c26-aec6-050f99d5b409`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:24:08,425::task::595::TaskManager.Task::(_updateState) Task=`1f40a92c-1d7f-4c26-aec6-050f99d5b409`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:24:08,425::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:24:08,425::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:24:08,426::task::990::TaskManager.Task::(_decref) Task=`1f40a92c-1d7f-4c26-aec6-050f99d5b409`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:24:08,547::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 10:24:08,548::task::595::TaskManager.Task::(_updateState) Task=`4a7b867d-32c4-4be4-a2f0-6a5c56f78c4d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:24:08,548::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:24:08,550::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`77d15ae8-6a56-40bf-b6ad-9fb549bc7bbe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:24:08,550::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:24:08,551::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:24:08,551::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`77d15ae8-6a56-40bf-b6ad-9fb549bc7bbe`::Granted request
>Thread-34::DEBUG::2014-08-21 10:24:08,552::task::827::TaskManager.Task::(resourceAcquired) Task=`4a7b867d-32c4-4be4-a2f0-6a5c56f78c4d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:24:08,552::task::990::TaskManager.Task::(_decref) Task=`4a7b867d-32c4-4be4-a2f0-6a5c56f78c4d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:24:08,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:08,648::task::1185::TaskManager.Task::(prepare) Task=`4a7b867d-32c4-4be4-a2f0-6a5c56f78c4d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:08,648::task::595::TaskManager.Task::(_updateState) Task=`4a7b867d-32c4-4be4-a2f0-6a5c56f78c4d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:24:08,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:24:08,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:24:08,650::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:24:08,723::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:24:08,723::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:24:08,724::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:24:08,724::task::990::TaskManager.Task::(_decref) Task=`4a7b867d-32c4-4be4-a2f0-6a5c56f78c4d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:24:09,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:10,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.835259 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:12,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:12,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.163502 s, 6.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:14,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:15,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.120359 s, 8.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:24:15,329::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:24:15,349::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00310163 s, 161 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:17,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:17,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.061394 s, 16.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:24:20,181::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Dummy-33::DEBUG::2014-08-21 10:24:20,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:24:20,653::task::595::TaskManager.Task::(_updateState) Task=`09bdd82d-9a11-46b2-860b-26b6c5d476fb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:24:20,657::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:24:20,659::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:24:20,660::task::1185::TaskManager.Task::(prepare) Task=`09bdd82d-9a11-46b2-860b-26b6c5d476fb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:24:20,662::task::595::TaskManager.Task::(_updateState) Task=`09bdd82d-9a11-46b2-860b-26b6c5d476fb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:24:20,662::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:24:20,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:24:20,668::task::990::TaskManager.Task::(_decref) Task=`09bdd82d-9a11-46b2-860b-26b6c5d476fb`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:24:20,834::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Thread-34::DEBUG::2014-08-21 10:24:20,842::task::595::TaskManager.Task::(_updateState) Task=`db59ef13-3fdb-432f-b044-8f9707e5e4b1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:24:20,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:24:20,909::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a11fa007-aac8-4b0b-bec7-078024c7be2a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:24:20,913::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:24:20,928::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:24:20,932::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a11fa007-aac8-4b0b-bec7-078024c7be2a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:24:20,939::task::827::TaskManager.Task::(resourceAcquired) Task=`db59ef13-3fdb-432f-b044-8f9707e5e4b1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:24:20,939::task::990::TaskManager.Task::(_decref) Task=`db59ef13-3fdb-432f-b044-8f9707e5e4b1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:24:21,141::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:21,141::task::1185::TaskManager.Task::(prepare) Task=`db59ef13-3fdb-432f-b044-8f9707e5e4b1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:21,142::task::595::TaskManager.Task::(_updateState) Task=`db59ef13-3fdb-432f-b044-8f9707e5e4b1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:24:21,142::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:24:21,142::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:24:21,146::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:24:21,146::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:24:21,146::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:24:21,146::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:24:21,147::task::990::TaskManager.Task::(_decref) Task=`db59ef13-3fdb-432f-b044-8f9707e5e4b1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:24:21,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.595142 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:23,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:23,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.123979 s, 8.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:24:23,649::task::595::TaskManager.Task::(_updateState) Task=`1c1d51fc-67f4-49c0-807f-51bfe83b22be`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:24:23,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:24:23,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00310163', 'lastCheck': '8.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:24:23,651::task::1185::TaskManager.Task::(prepare) Task=`1c1d51fc-67f4-49c0-807f-51bfe83b22be`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00310163', 'lastCheck': '8.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:24:23,651::task::595::TaskManager.Task::(_updateState) Task=`1c1d51fc-67f4-49c0-807f-51bfe83b22be`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:24:23,651::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:24:23,652::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:24:23,652::task::990::TaskManager.Task::(_decref) Task=`1c1d51fc-67f4-49c0-807f-51bfe83b22be`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:24:25,370::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:24:25,398::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00174982 s, 285 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:25,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:25,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.182196 s, 5.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:27,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:28,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0625301 s, 16.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:30,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:30,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0728312 s, 14.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:24:31,255::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-13::DEBUG::2014-08-21 10:24:31,866::task::595::TaskManager.Task::(_updateState) Task=`62fcf703-7217-40a4-900c-d894323c0a13`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:24:31,870::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:24:31,873::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:24:31,873::task::1185::TaskManager.Task::(prepare) Task=`62fcf703-7217-40a4-900c-d894323c0a13`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:24:31,874::task::595::TaskManager.Task::(_updateState) Task=`62fcf703-7217-40a4-900c-d894323c0a13`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:24:31,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:24:31,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:24:31,878::task::990::TaskManager.Task::(_decref) Task=`62fcf703-7217-40a4-900c-d894323c0a13`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:24:31,883::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-34::DEBUG::2014-08-21 10:24:31,883::task::595::TaskManager.Task::(_updateState) Task=`ae80ab3d-25d1-4f92-bb8a-7587315f8b1e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:24:31,884::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:24:31,884::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e5d6909e-c5ad-48a2-95e1-cc4067629daa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:24:31,885::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:24:31,885::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:24:31,885::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e5d6909e-c5ad-48a2-95e1-cc4067629daa`::Granted request
>Thread-34::DEBUG::2014-08-21 10:24:31,886::task::827::TaskManager.Task::(resourceAcquired) Task=`ae80ab3d-25d1-4f92-bb8a-7587315f8b1e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:24:31,886::task::990::TaskManager.Task::(_decref) Task=`ae80ab3d-25d1-4f92-bb8a-7587315f8b1e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:24:31,892::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897112576', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:31,892::task::1185::TaskManager.Task::(prepare) Task=`ae80ab3d-25d1-4f92-bb8a-7587315f8b1e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897112576', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:31,892::task::595::TaskManager.Task::(_updateState) Task=`ae80ab3d-25d1-4f92-bb8a-7587315f8b1e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:24:31,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:24:31,893::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:24:31,893::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:24:31,894::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:24:31,894::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:24:31,894::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:24:31,894::task::990::TaskManager.Task::(_decref) Task=`ae80ab3d-25d1-4f92-bb8a-7587315f8b1e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:24:32,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:32,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0627806 s, 16.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:34,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:34,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0749303 s, 13.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:24:35,420::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:24:35,442::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00412153 s, 121 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:36,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:37,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.660546 s, 1.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:24:38,828::task::595::TaskManager.Task::(_updateState) Task=`a0a47a6f-b6b3-409f-a557-0189b60dc8f2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:24:38,828::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:24:38,829::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00412153', 'lastCheck': '3.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:24:38,829::task::1185::TaskManager.Task::(prepare) Task=`a0a47a6f-b6b3-409f-a557-0189b60dc8f2`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00412153', 'lastCheck': '3.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:24:38,829::task::595::TaskManager.Task::(_updateState) Task=`a0a47a6f-b6b3-409f-a557-0189b60dc8f2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:24:38,830::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:24:38,830::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:24:38,830::task::990::TaskManager.Task::(_decref) Task=`a0a47a6f-b6b3-409f-a557-0189b60dc8f2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:24:39,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:40,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105058 s, 9.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:42,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:24:43,429::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-13::DEBUG::2014-08-21 10:24:43,431::task::595::TaskManager.Task::(_updateState) Task=`e8a37741-4d04-4502-8bb0-2dbf509856c1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:24:43,432::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:24:43,433::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:24:43,434::task::1185::TaskManager.Task::(prepare) Task=`e8a37741-4d04-4502-8bb0-2dbf509856c1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:24:43,443::task::595::TaskManager.Task::(_updateState) Task=`e8a37741-4d04-4502-8bb0-2dbf509856c1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:24:43,458::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:24:43,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:24:43,488::task::990::TaskManager.Task::(_decref) Task=`e8a37741-4d04-4502-8bb0-2dbf509856c1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:24:43,786::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-34::DEBUG::2014-08-21 10:24:43,787::task::595::TaskManager.Task::(_updateState) Task=`459956e6-9c24-40f6-ba95-231cf1a2062b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:24:43,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:24:43,790::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e3cb457a-eb9f-4e58-a480-c8aea4bee9bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:24:43,790::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:24:43,791::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:24:43,791::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e3cb457a-eb9f-4e58-a480-c8aea4bee9bb`::Granted request
>Thread-34::DEBUG::2014-08-21 10:24:43,792::task::827::TaskManager.Task::(resourceAcquired) Task=`459956e6-9c24-40f6-ba95-231cf1a2062b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:24:43,793::task::990::TaskManager.Task::(_decref) Task=`459956e6-9c24-40f6-ba95-231cf1a2062b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:24:43,800::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:43,801::task::1185::TaskManager.Task::(prepare) Task=`459956e6-9c24-40f6-ba95-231cf1a2062b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:43,801::task::595::TaskManager.Task::(_updateState) Task=`459956e6-9c24-40f6-ba95-231cf1a2062b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:24:43,802::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:24:43,802::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:24:43,803::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:24:43,804::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:24:43,805::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:24:43,805::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:24:43,805::task::990::TaskManager.Task::(_decref) Task=`459956e6-9c24-40f6-ba95-231cf1a2062b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:24:45,929::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:24:46,093::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0039319 s, 127 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:46,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.30224 s, 445 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:49,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:50,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.603143 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:53,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:24:54,939::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-26::DEBUG::2014-08-21 10:24:54,940::task::595::TaskManager.Task::(_updateState) Task=`e4b8e472-31b0-45cd-aae7-7077f2332ebf`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:24:54,941::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:24:54,942::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:24:54,942::task::1185::TaskManager.Task::(prepare) Task=`e4b8e472-31b0-45cd-aae7-7077f2332ebf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:24:54,943::task::595::TaskManager.Task::(_updateState) Task=`e4b8e472-31b0-45cd-aae7-7077f2332ebf`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:24:54,943::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:24:54,943::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:24:54,944::task::990::TaskManager.Task::(_decref) Task=`e4b8e472-31b0-45cd-aae7-7077f2332ebf`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:24:55,473::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 10:24:55,474::task::595::TaskManager.Task::(_updateState) Task=`408c5668-99dc-49b6-bdda-8709fda9e1d5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:24:55,474::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:24:55,475::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ce9c69c1-88f7-4bbd-977b-40ee56043c81`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:24:55,475::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:24:55,476::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:24:55,476::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ce9c69c1-88f7-4bbd-977b-40ee56043c81`::Granted request
>Thread-34::DEBUG::2014-08-21 10:24:55,477::task::827::TaskManager.Task::(resourceAcquired) Task=`408c5668-99dc-49b6-bdda-8709fda9e1d5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:24:55,477::task::990::TaskManager.Task::(_decref) Task=`408c5668-99dc-49b6-bdda-8709fda9e1d5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:24:55,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:55,489::task::1185::TaskManager.Task::(prepare) Task=`408c5668-99dc-49b6-bdda-8709fda9e1d5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:24:55,490::task::595::TaskManager.Task::(_updateState) Task=`408c5668-99dc-49b6-bdda-8709fda9e1d5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:24:55,490::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:24:55,490::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:24:55,491::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:24:55,491::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:24:55,491::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:24:55,491::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:24:55,492::task::990::TaskManager.Task::(_decref) Task=`408c5668-99dc-49b6-bdda-8709fda9e1d5`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:24:56,862::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:24:57,003::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00207645 s, 240 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:24:57,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.86471 s, 549 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:24:58,453::task::595::TaskManager.Task::(_updateState) Task=`ebb7c9cd-baf4-4a11-9985-8e07069843ee`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:24:58,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:24:58,455::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00207645', 'lastCheck': '1.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:24:58,455::task::1185::TaskManager.Task::(prepare) Task=`ebb7c9cd-baf4-4a11-9985-8e07069843ee`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00207645', 'lastCheck': '1.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:24:58,456::task::595::TaskManager.Task::(_updateState) Task=`ebb7c9cd-baf4-4a11-9985-8e07069843ee`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:24:58,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:24:58,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:24:58,457::task::990::TaskManager.Task::(_decref) Task=`ebb7c9cd-baf4-4a11-9985-8e07069843ee`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:24:59,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:24:59,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.14917 s, 6.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:02,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:25:02,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.445108 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:04,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:25:05,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.498072 s, 2.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:25:05,674::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-26::DEBUG::2014-08-21 10:25:05,676::task::595::TaskManager.Task::(_updateState) Task=`88aae0f7-e363-45f6-a51c-951fe248fe82`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:25:05,676::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:25:05,677::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:25:05,677::task::1185::TaskManager.Task::(prepare) Task=`88aae0f7-e363-45f6-a51c-951fe248fe82`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:25:05,678::task::595::TaskManager.Task::(_updateState) Task=`88aae0f7-e363-45f6-a51c-951fe248fe82`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:25:05,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:25:05,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:25:05,679::task::990::TaskManager.Task::(_decref) Task=`88aae0f7-e363-45f6-a51c-951fe248fe82`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:25:05,683::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 10:25:05,684::task::595::TaskManager.Task::(_updateState) Task=`260c1cdc-ffb1-4b7b-ab63-1eb1d12a7b94`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:25:05,685::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:25:05,686::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d7035419-6891-4600-a24a-34ec6ceda784`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:25:05,686::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:25:05,686::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:25:05,687::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d7035419-6891-4600-a24a-34ec6ceda784`::Granted request
>Thread-34::DEBUG::2014-08-21 10:25:05,687::task::827::TaskManager.Task::(resourceAcquired) Task=`260c1cdc-ffb1-4b7b-ab63-1eb1d12a7b94`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:25:05,688::task::990::TaskManager.Task::(_decref) Task=`260c1cdc-ffb1-4b7b-ab63-1eb1d12a7b94`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:25:05,693::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:25:05,694::task::1185::TaskManager.Task::(prepare) Task=`260c1cdc-ffb1-4b7b-ab63-1eb1d12a7b94`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:25:05,694::task::595::TaskManager.Task::(_updateState) Task=`260c1cdc-ffb1-4b7b-ab63-1eb1d12a7b94`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:25:05,694::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:25:05,695::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:25:05,695::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:25:05,695::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:25:05,696::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:25:05,696::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:25:05,696::task::990::TaskManager.Task::(_decref) Task=`260c1cdc-ffb1-4b7b-ab63-1eb1d12a7b94`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:25:07,180::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:25:07,318::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00173957 s, 286 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:09,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:25:09,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.200648 s, 5.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:11,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:25:21,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-13::DEBUG::2014-08-21 10:25:21,624::task::595::TaskManager.Task::(_updateState) Task=`db8f8b96-4ec8-4c76-8481-e731f3e577a3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:25:21,668::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:25:21,687::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:25:21,735::task::1185::TaskManager.Task::(prepare) Task=`db8f8b96-4ec8-4c76-8481-e731f3e577a3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:25:21,821::task::595::TaskManager.Task::(_updateState) Task=`db8f8b96-4ec8-4c76-8481-e731f3e577a3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:25:21,860::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:25:21,875::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:25:21,881::task::990::TaskManager.Task::(_decref) Task=`db8f8b96-4ec8-4c76-8481-e731f3e577a3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:25:22,414::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:25:22,434::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-34::DEBUG::2014-08-21 10:25:22,452::task::595::TaskManager.Task::(_updateState) Task=`3b52aea6-8aa8-4fdf-8222-7cb7581ac828`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:25:22,467::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:25:22,688::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00322766 s, 154 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:25:22,608::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1eebff3b-edad-42bd-ac0b-2c2d07ebc240`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:25:22,787::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:25:22,788::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:25:22,788::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1eebff3b-edad-42bd-ac0b-2c2d07ebc240`::Granted request
>Thread-34::DEBUG::2014-08-21 10:25:22,790::task::827::TaskManager.Task::(resourceAcquired) Task=`3b52aea6-8aa8-4fdf-8222-7cb7581ac828`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:25:22,807::task::990::TaskManager.Task::(_decref) Task=`3b52aea6-8aa8-4fdf-8222-7cb7581ac828`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:25:23,077::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:25:23,089::task::1185::TaskManager.Task::(prepare) Task=`3b52aea6-8aa8-4fdf-8222-7cb7581ac828`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:25:23,090::task::595::TaskManager.Task::(_updateState) Task=`3b52aea6-8aa8-4fdf-8222-7cb7581ac828`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:25:23,090::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:25:23,091::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:25:23,107::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:25:23,113::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:25:23,114::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:25:23,114::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:25:23,119::task::990::TaskManager.Task::(_decref) Task=`3b52aea6-8aa8-4fdf-8222-7cb7581ac828`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:25:23,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.33746 s, 307 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:25:25,625::task::595::TaskManager.Task::(_updateState) Task=`3e45982e-4328-49b1-97b3-8908c536f03e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:25:25,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:25:25,628::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00322766', 'lastCheck': '2.6', 'valid': True}}
>Dummy-33::DEBUG::2014-08-21 10:25:26,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:25:33,050::task::1185::TaskManager.Task::(prepare) Task=`3e45982e-4328-49b1-97b3-8908c536f03e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00322766', 'lastCheck': '2.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:25:33,064::task::595::TaskManager.Task::(_updateState) Task=`3e45982e-4328-49b1-97b3-8908c536f03e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:25:35,247::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-13::DEBUG::2014-08-21 10:25:35,707::task::595::TaskManager.Task::(_updateState) Task=`77b63df1-045d-4a0e-b867-2c60d0fe8fce`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:25:35,707::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:25:35,708::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:25:35,709::task::1185::TaskManager.Task::(prepare) Task=`77b63df1-045d-4a0e-b867-2c60d0fe8fce`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:25:35,709::task::595::TaskManager.Task::(_updateState) Task=`77b63df1-045d-4a0e-b867-2c60d0fe8fce`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:25:35,714::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:25:35,714::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:25:35,715::task::990::TaskManager.Task::(_decref) Task=`77b63df1-045d-4a0e-b867-2c60d0fe8fce`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:25:35,783::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:25:35,784::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:25:35,784::task::990::TaskManager.Task::(_decref) Task=`3e45982e-4328-49b1-97b3-8908c536f03e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:25:36,381::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 10:25:36,382::task::595::TaskManager.Task::(_updateState) Task=`a641db10-c060-4175-b147-c32865714f87`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:25:36,384::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:25:36,400::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9423e31b-7a75-4a54-8df4-2ad9b2d1a8ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:25:36,400::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:25:36,401::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:25:36,402::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9423e31b-7a75-4a54-8df4-2ad9b2d1a8ba`::Granted request
>Thread-34::DEBUG::2014-08-21 10:25:36,404::task::827::TaskManager.Task::(resourceAcquired) Task=`a641db10-c060-4175-b147-c32865714f87`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:25:36,972::task::990::TaskManager.Task::(_decref) Task=`a641db10-c060-4175-b147-c32865714f87`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:25:37,811::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:25:38,321::task::1185::TaskManager.Task::(prepare) Task=`a641db10-c060-4175-b147-c32865714f87`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-15::DEBUG::2014-08-21 10:25:37,824::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:25:38,846::task::595::TaskManager.Task::(_updateState) Task=`a641db10-c060-4175-b147-c32865714f87`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:25:40,098::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:25:40,099::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:25:40,121::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:25:40,122::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:25:40,130::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:25:40,131::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:25:40,334::task::990::TaskManager.Task::(_decref) Task=`a641db10-c060-4175-b147-c32865714f87`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:25:41,822::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.808914 s, 0.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:44,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.12776 s, 144 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:46,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:25:47,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10644 s, 9.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:49,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:25:49,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0711107 s, 14.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:51,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:25:51,961::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-26::DEBUG::2014-08-21 10:25:51,974::task::595::TaskManager.Task::(_updateState) Task=`5b2db1b4-2383-407a-910e-bb36cd89d042`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:25:51,974::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:25:51,975::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:25:51,976::task::1185::TaskManager.Task::(prepare) Task=`5b2db1b4-2383-407a-910e-bb36cd89d042`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:25:51,989::task::595::TaskManager.Task::(_updateState) Task=`5b2db1b4-2383-407a-910e-bb36cd89d042`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:25:51,990::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:25:51,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:25:51,991::task::990::TaskManager.Task::(_decref) Task=`5b2db1b4-2383-407a-910e-bb36cd89d042`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:25:52,020::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 10:25:52,022::task::595::TaskManager.Task::(_updateState) Task=`af4ea966-a77c-498e-b4c1-e9fb5be08a88`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:25:52,022::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:25:52,023::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1d447350-f9de-4aa1-bdde-cf82a0a2451a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:25:52,023::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:25:52,024::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:25:52,024::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1d447350-f9de-4aa1-bdde-cf82a0a2451a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:25:52,025::task::827::TaskManager.Task::(resourceAcquired) Task=`af4ea966-a77c-498e-b4c1-e9fb5be08a88`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:25:52,025::task::990::TaskManager.Task::(_decref) Task=`af4ea966-a77c-498e-b4c1-e9fb5be08a88`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:25:52,031::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:25:52,031::task::1185::TaskManager.Task::(prepare) Task=`af4ea966-a77c-498e-b4c1-e9fb5be08a88`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:25:52,031::task::595::TaskManager.Task::(_updateState) Task=`af4ea966-a77c-498e-b4c1-e9fb5be08a88`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:25:52,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:25:52,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:25:52,032::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:25:52,033::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:25:52,033::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:25:52,033::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:25:52,034::task::990::TaskManager.Task::(_decref) Task=`af4ea966-a77c-498e-b4c1-e9fb5be08a88`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:25:52,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.232559 s, 4.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:25:52,258::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:25:52,272::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000445163 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:54,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:25:54,197::task::595::TaskManager.Task::(_updateState) Task=`3a107be0-18b6-4cd8-b2bf-d267bdd0dd1a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:25:54,198::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:25:54,199::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445163', 'lastCheck': '1.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:25:54,199::task::1185::TaskManager.Task::(prepare) Task=`3a107be0-18b6-4cd8-b2bf-d267bdd0dd1a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445163', 'lastCheck': '1.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:25:54,199::task::595::TaskManager.Task::(_updateState) Task=`3a107be0-18b6-4cd8-b2bf-d267bdd0dd1a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:25:54,199::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:25:54,199::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:25:54,200::task::990::TaskManager.Task::(_decref) Task=`3a107be0-18b6-4cd8-b2bf-d267bdd0dd1a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:25:54,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0664879 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:56,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:25:56,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.444116 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:25:58,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:25:59,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0938945 s, 10.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:01,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:01,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.162068 s, 6.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:26:02,125::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-26::DEBUG::2014-08-21 10:26:02,126::task::595::TaskManager.Task::(_updateState) Task=`ee635820-91b6-47b3-905f-339beb2411f8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:26:02,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:26:02,127::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:02,128::task::1185::TaskManager.Task::(prepare) Task=`ee635820-91b6-47b3-905f-339beb2411f8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:02,128::task::595::TaskManager.Task::(_updateState) Task=`ee635820-91b6-47b3-905f-339beb2411f8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:26:02,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:26:02,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:26:02,253::task::990::TaskManager.Task::(_decref) Task=`ee635820-91b6-47b3-905f-339beb2411f8`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:26:03,291::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:26:03,368::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 10:26:03,583::task::595::TaskManager.Task::(_updateState) Task=`a4fb0d4b-fb91-4a6a-a9f2-b88e94b9e9ed`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:26:03,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 10:26:03,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:26:03,626::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`44ca8a28-362a-4ca2-a369-b3fe0f4253ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:26:03,947::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:26:03,948::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:26:03,949::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`44ca8a28-362a-4ca2-a369-b3fe0f4253ca`::Granted request
>Thread-34::DEBUG::2014-08-21 10:26:03,950::task::827::TaskManager.Task::(resourceAcquired) Task=`a4fb0d4b-fb91-4a6a-a9f2-b88e94b9e9ed`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:26:03,951::task::990::TaskManager.Task::(_decref) Task=`a4fb0d4b-fb91-4a6a-a9f2-b88e94b9e9ed`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:26:04,041::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:04,042::task::1185::TaskManager.Task::(prepare) Task=`a4fb0d4b-fb91-4a6a-a9f2-b88e94b9e9ed`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:04,043::task::595::TaskManager.Task::(_updateState) Task=`a4fb0d4b-fb91-4a6a-a9f2-b88e94b9e9ed`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:26:04,044::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:26:04,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:26:04,190::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:26:04,225::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:26:04,226::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:26:04,227::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:26:04,235::task::990::TaskManager.Task::(_decref) Task=`a4fb0d4b-fb91-4a6a-a9f2-b88e94b9e9ed`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:26:04,680::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00641651 s, 77.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:05,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.08849 s, 941 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:07,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:07,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0506922 s, 20.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:09,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:09,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.238357 s, 4.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:26:09,755::task::595::TaskManager.Task::(_updateState) Task=`a291a249-76a0-41ca-a3d0-571c7c77b9b7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:26:09,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:26:09,757::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00641651', 'lastCheck': '4.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:26:09,757::task::1185::TaskManager.Task::(prepare) Task=`a291a249-76a0-41ca-a3d0-571c7c77b9b7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00641651', 'lastCheck': '4.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:26:09,757::task::595::TaskManager.Task::(_updateState) Task=`a291a249-76a0-41ca-a3d0-571c7c77b9b7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:26:09,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:26:09,784::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:26:09,813::task::990::TaskManager.Task::(_decref) Task=`a291a249-76a0-41ca-a3d0-571c7c77b9b7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:26:11,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:11,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0553381 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:14,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:14,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.189933 s, 5.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:26:14,392::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-26::DEBUG::2014-08-21 10:26:14,393::task::595::TaskManager.Task::(_updateState) Task=`fae4cfc5-e116-4698-bd3a-38201e1d4e6f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:26:14,394::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:26:14,394::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:14,394::task::1185::TaskManager.Task::(prepare) Task=`fae4cfc5-e116-4698-bd3a-38201e1d4e6f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:14,395::task::595::TaskManager.Task::(_updateState) Task=`fae4cfc5-e116-4698-bd3a-38201e1d4e6f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:26:14,395::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:26:14,395::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:26:14,396::task::990::TaskManager.Task::(_decref) Task=`fae4cfc5-e116-4698-bd3a-38201e1d4e6f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:26:14,424::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-34::DEBUG::2014-08-21 10:26:14,425::task::595::TaskManager.Task::(_updateState) Task=`74aec182-7ce0-4905-8b83-2d5231b38ab4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:26:14,425::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:26:14,426::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ca07755-6e6e-4fdc-8a80-6746d43b8f26`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:26:14,426::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:26:14,426::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:26:14,427::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ca07755-6e6e-4fdc-8a80-6746d43b8f26`::Granted request
>Thread-34::DEBUG::2014-08-21 10:26:14,427::task::827::TaskManager.Task::(resourceAcquired) Task=`74aec182-7ce0-4905-8b83-2d5231b38ab4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:26:14,427::task::990::TaskManager.Task::(_decref) Task=`74aec182-7ce0-4905-8b83-2d5231b38ab4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:26:14,431::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:14,431::task::1185::TaskManager.Task::(prepare) Task=`74aec182-7ce0-4905-8b83-2d5231b38ab4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:14,432::task::595::TaskManager.Task::(_updateState) Task=`74aec182-7ce0-4905-8b83-2d5231b38ab4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:26:14,432::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:26:14,432::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:26:14,433::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:26:14,433::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:26:14,433::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:26:14,433::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:26:14,434::task::990::TaskManager.Task::(_decref) Task=`74aec182-7ce0-4905-8b83-2d5231b38ab4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:26:14,982::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:26:15,006::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00790549 s, 63.0 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:16,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:17,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.992464 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:19,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:19,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0621635 s, 16.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:22,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:26:24,570::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-26::DEBUG::2014-08-21 10:26:25,189::task::595::TaskManager.Task::(_updateState) Task=`a02c12c1-5a3c-4fca-a560-0db831be5006`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:26:25,190::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:26:25,191::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:25,191::task::1185::TaskManager.Task::(prepare) Task=`a02c12c1-5a3c-4fca-a560-0db831be5006`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:25,192::task::595::TaskManager.Task::(_updateState) Task=`a02c12c1-5a3c-4fca-a560-0db831be5006`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:26:25,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:26:25,192::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:26:25,193::task::990::TaskManager.Task::(_decref) Task=`a02c12c1-5a3c-4fca-a560-0db831be5006`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:26:26,051::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-13::DEBUG::2014-08-21 10:26:26,055::task::595::TaskManager.Task::(_updateState) Task=`2dfb6dc6-44d6-4e34-b35f-a501b04e50c8`::moving from state init -> state preparing
>Thread-34::DEBUG::2014-08-21 10:26:26,065::task::595::TaskManager.Task::(_updateState) Task=`66ee3821-ba3f-430f-9c10-146282dc5ece`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:26:26,069::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-34::INFO::2014-08-21 10:26:26,074::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:26:26,074::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00790549', 'lastCheck': '11.1', 'valid': True}}
>Thread-34::DEBUG::2014-08-21 10:26:26,079::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fb510358-319d-4f20-a18e-af06226d665e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:26:26,080::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:26:26,080::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:26:26,080::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fb510358-319d-4f20-a18e-af06226d665e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:26:26,081::task::827::TaskManager.Task::(resourceAcquired) Task=`66ee3821-ba3f-430f-9c10-146282dc5ece`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:26:26,082::task::990::TaskManager.Task::(_decref) Task=`66ee3821-ba3f-430f-9c10-146282dc5ece`::ref 1 aborting False
>Thread-13::DEBUG::2014-08-21 10:26:26,103::task::1185::TaskManager.Task::(prepare) Task=`2dfb6dc6-44d6-4e34-b35f-a501b04e50c8`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00790549', 'lastCheck': '11.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:26:26,106::task::595::TaskManager.Task::(_updateState) Task=`2dfb6dc6-44d6-4e34-b35f-a501b04e50c8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:26:26,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:26:26,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:26:26,116::task::990::TaskManager.Task::(_decref) Task=`2dfb6dc6-44d6-4e34-b35f-a501b04e50c8`::ref 0 aborting False
>Thread-34::INFO::2014-08-21 10:26:26,127::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:26,137::task::1185::TaskManager.Task::(prepare) Task=`66ee3821-ba3f-430f-9c10-146282dc5ece`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:26,140::task::595::TaskManager.Task::(_updateState) Task=`66ee3821-ba3f-430f-9c10-146282dc5ece`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:26:26,144::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:26:26,146::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:26:26,151::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:26:26,156::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:26:26,158::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:26:26,161::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-15::DEBUG::2014-08-21 10:26:26,163::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:26:26,178::task::990::TaskManager.Task::(_decref) Task=`66ee3821-ba3f-430f-9c10-146282dc5ece`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:26:26,209::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00166536 s, 299 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:26,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.18212 s, 866 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:28,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:28,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.172986 s, 5.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:31,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:31,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0738213 s, 13.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:33,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:26:37,225::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-26::DEBUG::2014-08-21 10:26:37,227::task::595::TaskManager.Task::(_updateState) Task=`6f20311e-1c5e-46ef-be4f-eae92c5adc6f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:26:37,228::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:26:37,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:37,229::task::1185::TaskManager.Task::(prepare) Task=`6f20311e-1c5e-46ef-be4f-eae92c5adc6f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:37,229::task::595::TaskManager.Task::(_updateState) Task=`6f20311e-1c5e-46ef-be4f-eae92c5adc6f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:26:37,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:26:37,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:26:37,230::task::990::TaskManager.Task::(_decref) Task=`6f20311e-1c5e-46ef-be4f-eae92c5adc6f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:26:37,255::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 10:26:37,257::task::595::TaskManager.Task::(_updateState) Task=`8658cdd2-58dc-4b81-a01a-d94d33d17bab`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:26:37,257::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:26:37,258::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`096f6a25-cead-44a0-9229-f5f482594513`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:26:37,258::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:26:37,259::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:26:37,259::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`096f6a25-cead-44a0-9229-f5f482594513`::Granted request
>Thread-34::DEBUG::2014-08-21 10:26:37,260::task::827::TaskManager.Task::(resourceAcquired) Task=`8658cdd2-58dc-4b81-a01a-d94d33d17bab`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:26:37,260::task::990::TaskManager.Task::(_decref) Task=`8658cdd2-58dc-4b81-a01a-d94d33d17bab`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:26:37,266::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:37,266::task::1185::TaskManager.Task::(prepare) Task=`8658cdd2-58dc-4b81-a01a-d94d33d17bab`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:37,266::task::595::TaskManager.Task::(_updateState) Task=`8658cdd2-58dc-4b81-a01a-d94d33d17bab`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:26:37,266::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:26:37,267::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:26:37,267::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:26:37,267::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:26:37,267::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:26:37,267::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:26:37,268::task::990::TaskManager.Task::(_decref) Task=`8658cdd2-58dc-4b81-a01a-d94d33d17bab`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:26:37,354::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:26:37,380::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00107093 s, 465 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:37,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.47027 s, 295 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:39,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:39,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.120883 s, 8.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:26:46,657::task::595::TaskManager.Task::(_updateState) Task=`29434b83-fde4-4fc9-87b1-ebf52b41ac28`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:26:46,676::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:26:46,770::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107093', 'lastCheck': '9.3', 'valid': True}}
>Dummy-33::DEBUG::2014-08-21 10:26:47,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:26:47,088::task::1185::TaskManager.Task::(prepare) Task=`29434b83-fde4-4fc9-87b1-ebf52b41ac28`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107093', 'lastCheck': '9.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:26:48,741::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-26::DEBUG::2014-08-21 10:26:48,758::task::595::TaskManager.Task::(_updateState) Task=`29434b83-fde4-4fc9-87b1-ebf52b41ac28`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:26:48,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:26:48,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:26:48,759::task::990::TaskManager.Task::(_decref) Task=`29434b83-fde4-4fc9-87b1-ebf52b41ac28`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:26:48,763::task::595::TaskManager.Task::(_updateState) Task=`c99a55dd-1cab-4303-b21f-e9e778ca9563`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:26:48,763::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:26:48,764::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:26:48,764::task::1185::TaskManager.Task::(prepare) Task=`c99a55dd-1cab-4303-b21f-e9e778ca9563`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:26:48,764::task::595::TaskManager.Task::(_updateState) Task=`c99a55dd-1cab-4303-b21f-e9e778ca9563`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:26:48,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:26:48,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:26:48,765::task::990::TaskManager.Task::(_decref) Task=`c99a55dd-1cab-4303-b21f-e9e778ca9563`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:26:48,856::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-34::DEBUG::2014-08-21 10:26:48,870::task::595::TaskManager.Task::(_updateState) Task=`e080c20c-0d51-4844-8209-88e35e5fafcb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:26:48,871::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:26:48,877::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8aede533-5739-4525-ae42-fea8d6ff5246`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:26:48,879::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:26:48,882::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:26:48,883::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8aede533-5739-4525-ae42-fea8d6ff5246`::Granted request
>Thread-34::DEBUG::2014-08-21 10:26:48,885::task::827::TaskManager.Task::(resourceAcquired) Task=`e080c20c-0d51-4844-8209-88e35e5fafcb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:26:48,886::task::990::TaskManager.Task::(_decref) Task=`e080c20c-0d51-4844-8209-88e35e5fafcb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:26:48,907::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:48,909::task::1185::TaskManager.Task::(prepare) Task=`e080c20c-0d51-4844-8209-88e35e5fafcb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:48,911::task::595::TaskManager.Task::(_updateState) Task=`e080c20c-0d51-4844-8209-88e35e5fafcb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:26:48,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:26:48,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:26:48,916::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:26:48,917::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:26:48,918::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:26:48,919::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:26:48,920::task::990::TaskManager.Task::(_decref) Task=`e080c20c-0d51-4844-8209-88e35e5fafcb`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:26:49,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:26:49,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00936446 s, 53.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:49,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.449774 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:51,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:51,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.379071 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:53,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:54,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.419441 s, 2.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:56,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:56,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0468645 s, 21.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:26:58,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:26:58,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0601667 s, 17.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:26:58,952::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-26::DEBUG::2014-08-21 10:26:58,954::task::595::TaskManager.Task::(_updateState) Task=`40feee2b-ab28-4da7-a453-a27410de3bed`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:26:58,963::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:26:58,966::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:58,967::task::1185::TaskManager.Task::(prepare) Task=`40feee2b-ab28-4da7-a453-a27410de3bed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:26:58,969::task::595::TaskManager.Task::(_updateState) Task=`40feee2b-ab28-4da7-a453-a27410de3bed`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:26:58,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:26:58,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:26:58,973::task::990::TaskManager.Task::(_decref) Task=`40feee2b-ab28-4da7-a453-a27410de3bed`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:26:59,023::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-34::DEBUG::2014-08-21 10:26:59,029::task::595::TaskManager.Task::(_updateState) Task=`291ad6ca-af87-4c34-871f-7b50723ac61c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:26:59,047::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:26:59,049::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aa9fd71c-39e1-4b42-9cd4-20b604296276`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:26:59,050::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:26:59,051::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:26:59,051::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aa9fd71c-39e1-4b42-9cd4-20b604296276`::Granted request
>Thread-34::DEBUG::2014-08-21 10:26:59,116::task::827::TaskManager.Task::(resourceAcquired) Task=`291ad6ca-af87-4c34-871f-7b50723ac61c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:26:59,123::task::990::TaskManager.Task::(_decref) Task=`291ad6ca-af87-4c34-871f-7b50723ac61c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:26:59,839::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:59,840::task::1185::TaskManager.Task::(prepare) Task=`291ad6ca-af87-4c34-871f-7b50723ac61c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:26:59,841::task::595::TaskManager.Task::(_updateState) Task=`291ad6ca-af87-4c34-871f-7b50723ac61c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:26:59,841::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:26:59,842::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:26:59,845::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:26:59,846::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:26:59,846::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:26:59,846::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:27:00,005::task::990::TaskManager.Task::(_decref) Task=`291ad6ca-af87-4c34-871f-7b50723ac61c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:27:00,172::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:27:00,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00214338 s, 232 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:00,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:01,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.09466 s, 10.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:03,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:27:04,367::task::595::TaskManager.Task::(_updateState) Task=`90eb8aef-e279-4092-b07b-7f971ba37c85`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:27:04,367::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:27:04,368::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00214338', 'lastCheck': '4.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:27:04,368::task::1185::TaskManager.Task::(prepare) Task=`90eb8aef-e279-4092-b07b-7f971ba37c85`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00214338', 'lastCheck': '4.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:27:04,369::task::595::TaskManager.Task::(_updateState) Task=`90eb8aef-e279-4092-b07b-7f971ba37c85`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:27:04,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:27:04,369::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:27:04,370::task::990::TaskManager.Task::(_decref) Task=`90eb8aef-e279-4092-b07b-7f971ba37c85`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:27:04,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.2165 s, 842 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:06,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:06,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.140214 s, 7.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:08,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:08,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0994397 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:11,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:27:11,611::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-26::DEBUG::2014-08-21 10:27:11,637::task::595::TaskManager.Task::(_updateState) Task=`06982b3a-a2bb-4fbe-a815-4a99d31d571e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:27:11,648::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:27:11,650::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:27:11,656::task::1185::TaskManager.Task::(prepare) Task=`06982b3a-a2bb-4fbe-a815-4a99d31d571e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:27:11,657::task::595::TaskManager.Task::(_updateState) Task=`06982b3a-a2bb-4fbe-a815-4a99d31d571e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:27:11,659::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:27:11,665::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:27:11,668::task::990::TaskManager.Task::(_decref) Task=`06982b3a-a2bb-4fbe-a815-4a99d31d571e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:27:11,704::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:27:11,721::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-34::DEBUG::2014-08-21 10:27:11,722::task::595::TaskManager.Task::(_updateState) Task=`d5353e10-8d06-4ade-ac0f-6bb3b825907f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:27:11,722::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:27:11,723::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`38717861-2024-475a-80a3-89cfd21dd5ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:27:11,724::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:27:11,724::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:27:11,724::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`38717861-2024-475a-80a3-89cfd21dd5ae`::Granted request
>Thread-34::DEBUG::2014-08-21 10:27:11,725::task::827::TaskManager.Task::(resourceAcquired) Task=`d5353e10-8d06-4ade-ac0f-6bb3b825907f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:27:11,725::task::990::TaskManager.Task::(_decref) Task=`d5353e10-8d06-4ade-ac0f-6bb3b825907f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:27:11,739::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:11,740::task::1185::TaskManager.Task::(prepare) Task=`d5353e10-8d06-4ade-ac0f-6bb3b825907f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:11,740::task::595::TaskManager.Task::(_updateState) Task=`d5353e10-8d06-4ade-ac0f-6bb3b825907f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:27:11,740::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:27:11,741::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:27:11,741::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:27:11,741::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:27:11,742::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:27:11,742::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:27:11,742::task::990::TaskManager.Task::(_decref) Task=`d5353e10-8d06-4ade-ac0f-6bb3b825907f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:27:11,793::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.001073 s, 464 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:11,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.231561 s, 4.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:13,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:14,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0683626 s, 15.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:16,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:18,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.40425 s, 426 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:20,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:20,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150947 s, 6.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:27:21,018::task::595::TaskManager.Task::(_updateState) Task=`182dff80-e78e-4ea6-99bd-7080d518222a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:27:21,019::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:27:21,019::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.001073', 'lastCheck': '9.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:27:21,019::task::1185::TaskManager.Task::(prepare) Task=`182dff80-e78e-4ea6-99bd-7080d518222a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.001073', 'lastCheck': '9.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:27:21,020::task::595::TaskManager.Task::(_updateState) Task=`182dff80-e78e-4ea6-99bd-7080d518222a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:27:21,020::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:27:21,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:27:21,020::task::990::TaskManager.Task::(_decref) Task=`182dff80-e78e-4ea6-99bd-7080d518222a`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:27:21,888::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-26::DEBUG::2014-08-21 10:27:23,301::task::595::TaskManager.Task::(_updateState) Task=`18e43ceb-1ebb-44f4-b3ef-fe3d4e6cae96`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:27:23,312::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 10:27:23,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::INFO::2014-08-21 10:27:23,343::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:27:23,533::task::1185::TaskManager.Task::(prepare) Task=`18e43ceb-1ebb-44f4-b3ef-fe3d4e6cae96`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:27:23,534::task::595::TaskManager.Task::(_updateState) Task=`18e43ceb-1ebb-44f4-b3ef-fe3d4e6cae96`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:27:23,535::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:27:23,535::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:27:23,536::task::990::TaskManager.Task::(_decref) Task=`18e43ceb-1ebb-44f4-b3ef-fe3d4e6cae96`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:27:23,733::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:27:23,751::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 10:27:23,759::task::595::TaskManager.Task::(_updateState) Task=`c1365b76-e4b6-4d0c-8fe4-1943aff55fbd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:27:23,761::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:27:23,767::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4e3f3151-7788-4960-94dc-ae264024eed9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:27:23,769::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:27:23,773::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:27:23,773::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4e3f3151-7788-4960-94dc-ae264024eed9`::Granted request
>Thread-34::DEBUG::2014-08-21 10:27:23,780::task::827::TaskManager.Task::(resourceAcquired) Task=`c1365b76-e4b6-4d0c-8fe4-1943aff55fbd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:27:23,787::task::990::TaskManager.Task::(_decref) Task=`c1365b76-e4b6-4d0c-8fe4-1943aff55fbd`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:27:23,805::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00433205 s, 115 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:27:23,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:23,860::task::1185::TaskManager.Task::(prepare) Task=`c1365b76-e4b6-4d0c-8fe4-1943aff55fbd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:23,861::task::595::TaskManager.Task::(_updateState) Task=`c1365b76-e4b6-4d0c-8fe4-1943aff55fbd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:27:23,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:27:23,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:27:23,863::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:27:23,864::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:27:23,864::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:27:23,865::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:27:23,865::task::990::TaskManager.Task::(_decref) Task=`c1365b76-e4b6-4d0c-8fe4-1943aff55fbd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:27:23,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.525791 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:25,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:26,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0524552 s, 19.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:28,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:30,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.38582 s, 429 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:32,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:32,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0879582 s, 11.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:27:33,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:27:33,907::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-26::DEBUG::2014-08-21 10:27:33,950::task::595::TaskManager.Task::(_updateState) Task=`df5be054-ad6b-4249-ab98-f41779f241fa`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:27:33,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:27:33,961::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:27:33,966::task::1185::TaskManager.Task::(prepare) Task=`df5be054-ad6b-4249-ab98-f41779f241fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-15::DEBUG::2014-08-21 10:27:33,976::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000495222 s, 1.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:27:33,978::task::595::TaskManager.Task::(_updateState) Task=`df5be054-ad6b-4249-ab98-f41779f241fa`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:27:33,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:27:33,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:27:34,013::task::990::TaskManager.Task::(_decref) Task=`df5be054-ad6b-4249-ab98-f41779f241fa`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:27:34,288::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-34::DEBUG::2014-08-21 10:27:34,290::task::595::TaskManager.Task::(_updateState) Task=`4a3fbde4-6856-4db1-b76a-41a4c243b1dd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:27:34,291::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:27:34,488::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2c7baf01-62aa-46b6-9f35-72cf5f489a0c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:27:34,489::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:27:34,491::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:27:34,492::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2c7baf01-62aa-46b6-9f35-72cf5f489a0c`::Granted request
>Thread-34::DEBUG::2014-08-21 10:27:34,493::task::827::TaskManager.Task::(resourceAcquired) Task=`4a3fbde4-6856-4db1-b76a-41a4c243b1dd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:27:34,494::task::990::TaskManager.Task::(_decref) Task=`4a3fbde4-6856-4db1-b76a-41a4c243b1dd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:27:34,531::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:34,531::task::1185::TaskManager.Task::(prepare) Task=`4a3fbde4-6856-4db1-b76a-41a4c243b1dd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:34,532::task::595::TaskManager.Task::(_updateState) Task=`4a3fbde4-6856-4db1-b76a-41a4c243b1dd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:27:34,533::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:27:34,533::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:27:34,545::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:27:34,547::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:27:34,547::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:27:34,547::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:27:34,548::task::990::TaskManager.Task::(_decref) Task=`4a3fbde4-6856-4db1-b76a-41a4c243b1dd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:27:34,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:36,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.296248 s, 3.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:27:36,339::task::595::TaskManager.Task::(_updateState) Task=`b155f437-7291-49b8-8a3b-73db2a920a5b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:27:36,340::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:27:36,340::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495222', 'lastCheck': '2.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:27:36,340::task::1185::TaskManager.Task::(prepare) Task=`b155f437-7291-49b8-8a3b-73db2a920a5b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495222', 'lastCheck': '2.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:27:36,341::task::595::TaskManager.Task::(_updateState) Task=`b155f437-7291-49b8-8a3b-73db2a920a5b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:27:36,341::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:27:36,341::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:27:36,342::task::990::TaskManager.Task::(_decref) Task=`b155f437-7291-49b8-8a3b-73db2a920a5b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:27:38,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:38,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.05036 s, 20.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:40,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:40,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0693981 s, 14.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:42,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:42,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0820863 s, 12.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:27:44,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:27:44,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000523709 s, 951 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:27:44,668::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-26::DEBUG::2014-08-21 10:27:44,671::task::595::TaskManager.Task::(_updateState) Task=`309717a4-e662-4dd5-83ac-a22fae5e049e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:27:44,672::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:27:44,673::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:27:44,673::task::1185::TaskManager.Task::(prepare) Task=`309717a4-e662-4dd5-83ac-a22fae5e049e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:27:44,673::task::595::TaskManager.Task::(_updateState) Task=`309717a4-e662-4dd5-83ac-a22fae5e049e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:27:44,674::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:27:44,674::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:27:44,675::task::990::TaskManager.Task::(_decref) Task=`309717a4-e662-4dd5-83ac-a22fae5e049e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:27:44,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:27:44,719::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-34::DEBUG::2014-08-21 10:27:44,721::task::595::TaskManager.Task::(_updateState) Task=`eb67bf99-9fae-4d52-9213-c867a175a7e6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:27:44,722::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:27:44,724::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c7d9f4e6-3bc5-4e8f-b8ef-8e7e52af1182`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:27:44,725::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:27:44,729::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:27:44,733::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c7d9f4e6-3bc5-4e8f-b8ef-8e7e52af1182`::Granted request
>Thread-34::DEBUG::2014-08-21 10:27:44,739::task::827::TaskManager.Task::(resourceAcquired) Task=`eb67bf99-9fae-4d52-9213-c867a175a7e6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:27:44,742::task::990::TaskManager.Task::(_decref) Task=`eb67bf99-9fae-4d52-9213-c867a175a7e6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:27:44,771::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:44,774::task::1185::TaskManager.Task::(prepare) Task=`eb67bf99-9fae-4d52-9213-c867a175a7e6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:44,775::task::595::TaskManager.Task::(_updateState) Task=`eb67bf99-9fae-4d52-9213-c867a175a7e6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:27:44,776::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:27:44,777::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:27:44,779::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:27:44,781::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:27:44,783::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:27:44,784::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:27:44,786::task::990::TaskManager.Task::(_decref) Task=`eb67bf99-9fae-4d52-9213-c867a175a7e6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:27:44,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.129491 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:46,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:47,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125723 s, 8.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:49,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:49,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426722 s, 24.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:51,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:51,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0805315 s, 12.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:27:51,649::task::595::TaskManager.Task::(_updateState) Task=`96dad092-ea51-4cba-9a46-eee4db537b32`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:27:51,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:27:51,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523709', 'lastCheck': '7.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:27:51,652::task::1185::TaskManager.Task::(prepare) Task=`96dad092-ea51-4cba-9a46-eee4db537b32`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523709', 'lastCheck': '7.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:27:51,653::task::595::TaskManager.Task::(_updateState) Task=`96dad092-ea51-4cba-9a46-eee4db537b32`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:27:51,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:27:51,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:27:51,654::task::990::TaskManager.Task::(_decref) Task=`96dad092-ea51-4cba-9a46-eee4db537b32`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:27:53,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:53,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.284564 s, 3.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:27:54,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:27:54,952::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-13::DEBUG::2014-08-21 10:27:54,964::task::595::TaskManager.Task::(_updateState) Task=`c35511c7-0ac4-48c4-92cc-f3dff4aa8aaa`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:27:54,965::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:27:54,966::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:27:54,967::task::1185::TaskManager.Task::(prepare) Task=`c35511c7-0ac4-48c4-92cc-f3dff4aa8aaa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:27:54,993::task::595::TaskManager.Task::(_updateState) Task=`c35511c7-0ac4-48c4-92cc-f3dff4aa8aaa`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:27:54,994::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:27:54,995::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:27:55,009::task::990::TaskManager.Task::(_decref) Task=`c35511c7-0ac4-48c4-92cc-f3dff4aa8aaa`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:27:55,306::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00110153 s, 452 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:27:55,613::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-34::DEBUG::2014-08-21 10:27:55,615::task::595::TaskManager.Task::(_updateState) Task=`e3a3bd2f-9fd3-4400-a2b1-17c9cfcf73c2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:27:55,616::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:27:55,619::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a62aae22-8f26-4c4e-915d-037899540440`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:27:55,620::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:27:55,621::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:27:55,622::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a62aae22-8f26-4c4e-915d-037899540440`::Granted request
>Thread-34::DEBUG::2014-08-21 10:27:55,624::task::827::TaskManager.Task::(resourceAcquired) Task=`e3a3bd2f-9fd3-4400-a2b1-17c9cfcf73c2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:27:55,625::task::990::TaskManager.Task::(_decref) Task=`e3a3bd2f-9fd3-4400-a2b1-17c9cfcf73c2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:27:55,650::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:55,651::task::1185::TaskManager.Task::(prepare) Task=`e3a3bd2f-9fd3-4400-a2b1-17c9cfcf73c2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:27:55,652::task::595::TaskManager.Task::(_updateState) Task=`e3a3bd2f-9fd3-4400-a2b1-17c9cfcf73c2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:27:55,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:27:55,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:27:55,655::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:27:55,656::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:27:55,657::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:27:55,658::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:27:55,659::task::990::TaskManager.Task::(_decref) Task=`e3a3bd2f-9fd3-4400-a2b1-17c9cfcf73c2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:27:55,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:56,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.117312 s, 8.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:27:58,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:27:58,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.319005 s, 3.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:00,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:28:02,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.550515 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:04,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:28:05,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150715 s, 6.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:28:05,636::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:28:05,659::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000619786 s, 804 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:28:05,686::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-13::DEBUG::2014-08-21 10:28:05,687::task::595::TaskManager.Task::(_updateState) Task=`d7983144-d97e-4d8d-a182-c41223707c42`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:28:05,688::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:28:05,688::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:28:05,688::task::1185::TaskManager.Task::(prepare) Task=`d7983144-d97e-4d8d-a182-c41223707c42`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:28:05,689::task::595::TaskManager.Task::(_updateState) Task=`d7983144-d97e-4d8d-a182-c41223707c42`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:28:05,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:28:05,689::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:28:05,689::task::990::TaskManager.Task::(_decref) Task=`d7983144-d97e-4d8d-a182-c41223707c42`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:28:05,694::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-34::DEBUG::2014-08-21 10:28:05,694::task::595::TaskManager.Task::(_updateState) Task=`0c839243-fee7-473e-a6ce-cb95c00de2d1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:28:05,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:28:05,695::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1cea52e-49b7-4905-a242-329d36564631`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:28:05,695::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:28:05,696::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:28:05,696::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1cea52e-49b7-4905-a242-329d36564631`::Granted request
>Thread-34::DEBUG::2014-08-21 10:28:05,696::task::827::TaskManager.Task::(resourceAcquired) Task=`0c839243-fee7-473e-a6ce-cb95c00de2d1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:28:05,697::task::990::TaskManager.Task::(_decref) Task=`0c839243-fee7-473e-a6ce-cb95c00de2d1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:28:05,700::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:28:05,701::task::1185::TaskManager.Task::(prepare) Task=`0c839243-fee7-473e-a6ce-cb95c00de2d1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:28:05,701::task::595::TaskManager.Task::(_updateState) Task=`0c839243-fee7-473e-a6ce-cb95c00de2d1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:28:05,701::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:28:05,701::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:28:05,702::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:28:05,702::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:28:05,702::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:28:05,702::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:28:05,703::task::990::TaskManager.Task::(_decref) Task=`0c839243-fee7-473e-a6ce-cb95c00de2d1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:28:07,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:28:08,089::task::595::TaskManager.Task::(_updateState) Task=`9896c223-919e-4654-8020-ba18d9081e74`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:28:08,090::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:28:08,090::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619786', 'lastCheck': '2.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:28:08,090::task::1185::TaskManager.Task::(prepare) Task=`9896c223-919e-4654-8020-ba18d9081e74`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619786', 'lastCheck': '2.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:28:08,090::task::595::TaskManager.Task::(_updateState) Task=`9896c223-919e-4654-8020-ba18d9081e74`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:28:08,091::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:28:08,091::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:28:08,091::task::990::TaskManager.Task::(_decref) Task=`9896c223-919e-4654-8020-ba18d9081e74`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:28:08,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.39265 s, 735 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:10,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:28:10,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.274328 s, 3.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:12,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:28:15,739::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [65f62e0f]
>Thread-15::DEBUG::2014-08-21 10:28:15,793::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-26::DEBUG::2014-08-21 10:28:15,798::task::595::TaskManager.Task::(_updateState) Task=`96f7377e-33f5-4dc3-96c8-ec9c66601e72`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:28:15,821::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:28:15,891::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:28:15,898::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:28:15,909::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:28:15,918::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:28:15,920::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:28:15,921::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-26::INFO::2014-08-21 10:28:15,927::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:28:15,931::task::1185::TaskManager.Task::(prepare) Task=`96f7377e-33f5-4dc3-96c8-ec9c66601e72`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:28:15,935::task::595::TaskManager.Task::(_updateState) Task=`96f7377e-33f5-4dc3-96c8-ec9c66601e72`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:28:15,940::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:28:15,944::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:28:15,948::task::990::TaskManager.Task::(_decref) Task=`96f7377e-33f5-4dc3-96c8-ec9c66601e72`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:28:15,973::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [65f62e0f]
>Thread-34::DEBUG::2014-08-21 10:28:15,981::task::595::TaskManager.Task::(_updateState) Task=`a4c05144-8ee4-4199-a2c8-9950f695d610`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:28:15,988::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:28:16,002::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`063cb809-3b68-463c-8b18-97c81be19dd7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:28:16,006::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:28:16,015::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:28:16,017::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`063cb809-3b68-463c-8b18-97c81be19dd7`::Granted request
>Thread-34::DEBUG::2014-08-21 10:28:16,024::task::827::TaskManager.Task::(resourceAcquired) Task=`a4c05144-8ee4-4199-a2c8-9950f695d610`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:28:16,027::task::990::TaskManager.Task::(_decref) Task=`a4c05144-8ee4-4199-a2c8-9950f695d610`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:28:16,042::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:28:16,098::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:28:16,103::task::1185::TaskManager.Task::(prepare) Task=`a4c05144-8ee4-4199-a2c8-9950f695d610`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:28:16,106::task::595::TaskManager.Task::(_updateState) Task=`a4c05144-8ee4-4199-a2c8-9950f695d610`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:28:16,108::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:28:16,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:28:16,115::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:28:16,120::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:28:16,123::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:28:16,126::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:28:16,130::task::990::TaskManager.Task::(_decref) Task=`a4c05144-8ee4-4199-a2c8-9950f695d610`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:28:16,155::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00144503 s, 345 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:16,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.24065 s, 316 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:18,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:28:20,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.82547 s, 561 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:22,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:28:23,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.383391 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:25,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:28:28,112::task::595::TaskManager.Task::(_updateState) Task=`653eb984-2624-4c6d-956a-5bc00fd07bb3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:28:28,113::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:28:28,114::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00144503', 'lastCheck': '11.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:28:28,116::task::1185::TaskManager.Task::(prepare) Task=`653eb984-2624-4c6d-956a-5bc00fd07bb3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00144503', 'lastCheck': '11.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:28:28,117::task::595::TaskManager.Task::(_updateState) Task=`653eb984-2624-4c6d-956a-5bc00fd07bb3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:28:28,117::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:28:28,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:28:28,119::task::990::TaskManager.Task::(_decref) Task=`653eb984-2624-4c6d-956a-5bc00fd07bb3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:28:28,249::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-13::DEBUG::2014-08-21 10:28:28,678::task::595::TaskManager.Task::(_updateState) Task=`4c3ffe31-5a5a-4143-8e77-ddb7ebac759d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:28:28,695::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:28:49,004::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:28:49,071::task::1185::TaskManager.Task::(prepare) Task=`4c3ffe31-5a5a-4143-8e77-ddb7ebac759d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:28:49,087::task::595::TaskManager.Task::(_updateState) Task=`4c3ffe31-5a5a-4143-8e77-ddb7ebac759d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:28:49,116::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:28:49,123::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:28:49,142::task::990::TaskManager.Task::(_decref) Task=`4c3ffe31-5a5a-4143-8e77-ddb7ebac759d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:28:49,229::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-34::DEBUG::2014-08-21 10:28:49,243::task::595::TaskManager.Task::(_updateState) Task=`39436eef-b577-4a7b-9627-5d1e846e3296`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:28:49,248::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:28:49,266::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c3e3e9ea-7eaf-46ab-b0f7-f118a3a4306e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:28:49,268::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:28:49,303::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:28:49,306::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c3e3e9ea-7eaf-46ab-b0f7-f118a3a4306e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:28:49,327::task::827::TaskManager.Task::(resourceAcquired) Task=`39436eef-b577-4a7b-9627-5d1e846e3296`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:28:49,329::task::990::TaskManager.Task::(_decref) Task=`39436eef-b577-4a7b-9627-5d1e846e3296`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:28:49,339::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:28:49,340::task::1185::TaskManager.Task::(prepare) Task=`39436eef-b577-4a7b-9627-5d1e846e3296`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:28:49,341::task::595::TaskManager.Task::(_updateState) Task=`39436eef-b577-4a7b-9627-5d1e846e3296`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:28:49,342::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:28:49,345::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:28:49,347::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:28:49,349::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:28:49,350::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:28:49,351::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:28:49,354::task::990::TaskManager.Task::(_decref) Task=`39436eef-b577-4a7b-9627-5d1e846e3296`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:28:49,367::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:28:49,414::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00082266 s, 605 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:49,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 24.1157 s, 42.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:51,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:28:51,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0963396 s, 10.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:28:53,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:29:08,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [377be1f8]
>Thread-13::DEBUG::2014-08-21 10:29:08,356::task::595::TaskManager.Task::(_updateState) Task=`3ba4d13c-502c-42b8-8dfc-1bf2693c5149`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:29:08,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:29:08,357::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:29:08,358::task::1185::TaskManager.Task::(prepare) Task=`3ba4d13c-502c-42b8-8dfc-1bf2693c5149`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:29:08,358::task::595::TaskManager.Task::(_updateState) Task=`3ba4d13c-502c-42b8-8dfc-1bf2693c5149`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:29:08,358::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:29:08,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:29:08,359::task::990::TaskManager.Task::(_decref) Task=`3ba4d13c-502c-42b8-8dfc-1bf2693c5149`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:29:08,575::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [377be1f8]
>Thread-34::DEBUG::2014-08-21 10:29:08,591::task::595::TaskManager.Task::(_updateState) Task=`ec589d9c-de8b-4780-9b98-b9dfd22c5dc3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:29:08,592::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:29:08,594::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d94119bf-7ac6-472c-a326-273790a5e66d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:29:08,594::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:29:08,595::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:29:08,596::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d94119bf-7ac6-472c-a326-273790a5e66d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:29:08,868::task::827::TaskManager.Task::(resourceAcquired) Task=`ec589d9c-de8b-4780-9b98-b9dfd22c5dc3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:29:08,895::task::990::TaskManager.Task::(_decref) Task=`ec589d9c-de8b-4780-9b98-b9dfd22c5dc3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:29:09,021::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:09,024::task::1185::TaskManager.Task::(prepare) Task=`ec589d9c-de8b-4780-9b98-b9dfd22c5dc3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:09,025::task::595::TaskManager.Task::(_updateState) Task=`ec589d9c-de8b-4780-9b98-b9dfd22c5dc3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:29:09,026::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:29:09,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:29:09,038::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:29:09,043::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:29:09,044::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:29:09,045::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:29:09,047::task::990::TaskManager.Task::(_decref) Task=`ec589d9c-de8b-4780-9b98-b9dfd22c5dc3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:29:09,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.40461 s, 729 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:11,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:13,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.445037 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:16,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:29:18,772::task::595::TaskManager.Task::(_updateState) Task=`dd36af2f-37d7-45d9-bfa2-72291838e29e`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 10:29:19,486::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-26::INFO::2014-08-21 10:29:19,528::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:29:19,752::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00082266', 'lastCheck': '11.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:29:19,763::task::1185::TaskManager.Task::(prepare) Task=`dd36af2f-37d7-45d9-bfa2-72291838e29e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00082266', 'lastCheck': '11.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:29:19,790::task::595::TaskManager.Task::(_updateState) Task=`dd36af2f-37d7-45d9-bfa2-72291838e29e`::moving from state preparing -> state finished
>Dummy-33::DEBUG::2014-08-21 10:29:20,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.860314 s, 1.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:29:20,891::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:29:20,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:29:20,892::task::990::TaskManager.Task::(_decref) Task=`dd36af2f-37d7-45d9-bfa2-72291838e29e`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:29:20,894::task::595::TaskManager.Task::(_updateState) Task=`3af3036e-12ac-460c-ad2e-8908b375de8c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:29:20,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:29:20,896::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:29:20,896::task::1185::TaskManager.Task::(prepare) Task=`3af3036e-12ac-460c-ad2e-8908b375de8c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:29:20,896::task::595::TaskManager.Task::(_updateState) Task=`3af3036e-12ac-460c-ad2e-8908b375de8c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:29:20,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:29:20,897::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:29:20,897::task::990::TaskManager.Task::(_decref) Task=`3af3036e-12ac-460c-ad2e-8908b375de8c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:29:21,090::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:29:21,141::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-15::DEBUG::2014-08-21 10:29:21,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000482172 s, 1.0 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:29:21,366::task::595::TaskManager.Task::(_updateState) Task=`6e320dc2-d404-4d51-bf12-3c2025db3c83`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:29:21,507::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:29:21,558::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`56864372-b496-45dc-8f8e-c46567b225ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:29:21,560::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:29:21,562::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:29:21,563::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`56864372-b496-45dc-8f8e-c46567b225ae`::Granted request
>Thread-34::DEBUG::2014-08-21 10:29:21,566::task::827::TaskManager.Task::(resourceAcquired) Task=`6e320dc2-d404-4d51-bf12-3c2025db3c83`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:29:21,566::task::990::TaskManager.Task::(_decref) Task=`6e320dc2-d404-4d51-bf12-3c2025db3c83`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:29:21,623::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:21,624::task::1185::TaskManager.Task::(prepare) Task=`6e320dc2-d404-4d51-bf12-3c2025db3c83`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:21,626::task::595::TaskManager.Task::(_updateState) Task=`6e320dc2-d404-4d51-bf12-3c2025db3c83`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:29:21,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:29:21,629::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:29:21,633::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:29:21,636::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:29:21,637::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:29:21,638::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:29:21,642::task::990::TaskManager.Task::(_decref) Task=`6e320dc2-d404-4d51-bf12-3c2025db3c83`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:29:22,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:23,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100464 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:25,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:25,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0609036 s, 16.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:27,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:27,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0588272 s, 17.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:29,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:29,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.120294 s, 8.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:29:31,641::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:29:31,668::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000686064 s, 726 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:29:31,670::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-26::DEBUG::2014-08-21 10:29:31,671::task::595::TaskManager.Task::(_updateState) Task=`a058901e-364f-4691-9336-c21d2766c59a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:29:31,671::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:29:31,672::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:29:31,672::task::1185::TaskManager.Task::(prepare) Task=`a058901e-364f-4691-9336-c21d2766c59a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:29:31,672::task::595::TaskManager.Task::(_updateState) Task=`a058901e-364f-4691-9336-c21d2766c59a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:29:31,673::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:29:31,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:29:31,673::task::990::TaskManager.Task::(_decref) Task=`a058901e-364f-4691-9336-c21d2766c59a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:29:31,682::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-34::DEBUG::2014-08-21 10:29:31,694::task::595::TaskManager.Task::(_updateState) Task=`211ec60a-b053-4196-a04f-902eb0f28a69`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:29:31,699::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:29:31,705::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f67a6983-2dd1-4fe5-8034-b92e570200cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:29:31,705::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:29:31,707::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:29:31,708::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f67a6983-2dd1-4fe5-8034-b92e570200cb`::Granted request
>Thread-34::DEBUG::2014-08-21 10:29:31,713::task::827::TaskManager.Task::(resourceAcquired) Task=`211ec60a-b053-4196-a04f-902eb0f28a69`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:29:31,714::task::990::TaskManager.Task::(_decref) Task=`211ec60a-b053-4196-a04f-902eb0f28a69`::ref 1 aborting False
>Dummy-33::DEBUG::2014-08-21 10:29:31,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::INFO::2014-08-21 10:29:31,772::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:31,772::task::1185::TaskManager.Task::(prepare) Task=`211ec60a-b053-4196-a04f-902eb0f28a69`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:31,774::task::595::TaskManager.Task::(_updateState) Task=`211ec60a-b053-4196-a04f-902eb0f28a69`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:29:31,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:29:31,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:29:31,800::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:29:31,802::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:29:31,803::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:29:31,804::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:29:31,807::task::990::TaskManager.Task::(_decref) Task=`211ec60a-b053-4196-a04f-902eb0f28a69`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:29:32,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.277317 s, 3.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:34,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:34,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.203954 s, 5.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:36,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:36,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0682403 s, 15.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:29:37,307::task::595::TaskManager.Task::(_updateState) Task=`f2303f13-fadd-436c-a18b-a7a94ee83d58`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:29:37,308::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:29:37,308::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686064', 'lastCheck': '5.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:29:37,309::task::1185::TaskManager.Task::(prepare) Task=`f2303f13-fadd-436c-a18b-a7a94ee83d58`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686064', 'lastCheck': '5.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:29:37,309::task::595::TaskManager.Task::(_updateState) Task=`f2303f13-fadd-436c-a18b-a7a94ee83d58`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:29:37,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:29:37,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:29:37,310::task::990::TaskManager.Task::(_decref) Task=`f2303f13-fadd-436c-a18b-a7a94ee83d58`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:29:38,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:40,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.40646 s, 728 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:29:41,714::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:29:41,733::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000700211 s, 711 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:29:41,838::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-26::DEBUG::2014-08-21 10:29:41,839::task::595::TaskManager.Task::(_updateState) Task=`6a4d8b3f-bbb1-4f70-9af0-3fad2721daa3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:29:41,840::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:29:41,841::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:29:41,841::task::1185::TaskManager.Task::(prepare) Task=`6a4d8b3f-bbb1-4f70-9af0-3fad2721daa3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:29:41,841::task::595::TaskManager.Task::(_updateState) Task=`6a4d8b3f-bbb1-4f70-9af0-3fad2721daa3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:29:41,842::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:29:41,842::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:29:41,842::task::990::TaskManager.Task::(_decref) Task=`6a4d8b3f-bbb1-4f70-9af0-3fad2721daa3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:29:41,847::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-34::DEBUG::2014-08-21 10:29:41,847::task::595::TaskManager.Task::(_updateState) Task=`d5bcbbee-9bbb-4e0c-8540-960f8a2cc2d6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:29:41,848::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:29:41,848::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2ced9907-a681-4b83-8cc7-952c2381f60f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:29:41,848::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:29:41,849::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:29:41,849::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2ced9907-a681-4b83-8cc7-952c2381f60f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:29:41,850::task::827::TaskManager.Task::(resourceAcquired) Task=`d5bcbbee-9bbb-4e0c-8540-960f8a2cc2d6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:29:41,850::task::990::TaskManager.Task::(_decref) Task=`d5bcbbee-9bbb-4e0c-8540-960f8a2cc2d6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:29:41,854::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:41,854::task::1185::TaskManager.Task::(prepare) Task=`d5bcbbee-9bbb-4e0c-8540-960f8a2cc2d6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:41,855::task::595::TaskManager.Task::(_updateState) Task=`d5bcbbee-9bbb-4e0c-8540-960f8a2cc2d6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:29:41,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:29:41,855::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:29:41,855::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:29:41,856::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:29:41,856::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:29:41,856::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:29:41,856::task::990::TaskManager.Task::(_decref) Task=`d5bcbbee-9bbb-4e0c-8540-960f8a2cc2d6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:29:42,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:42,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0518678 s, 19.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:44,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:44,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.066645 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:46,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:46,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0849507 s, 12.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:48,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:29:48,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399557 s, 25.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:51,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:29:52,248::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-26::DEBUG::2014-08-21 10:29:52,249::task::595::TaskManager.Task::(_updateState) Task=`11596b30-039b-49e5-ab93-30a59b580f54`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:29:52,250::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:29:52,251::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:29:52,267::task::1185::TaskManager.Task::(prepare) Task=`11596b30-039b-49e5-ab93-30a59b580f54`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:29:52,282::task::595::TaskManager.Task::(_updateState) Task=`11596b30-039b-49e5-ab93-30a59b580f54`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:29:52,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:29:52,283::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:29:52,284::task::990::TaskManager.Task::(_decref) Task=`11596b30-039b-49e5-ab93-30a59b580f54`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:29:52,731::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-34::DEBUG::2014-08-21 10:29:53,222::task::595::TaskManager.Task::(_updateState) Task=`416fcbc5-e794-46dd-89ea-f22a890e8af5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:29:53,223::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::DEBUG::2014-08-21 10:29:52,849::task::595::TaskManager.Task::(_updateState) Task=`273ad807-a203-44e1-b2a6-7af53b427dbb`::moving from state init -> state preparing
>Thread-34::DEBUG::2014-08-21 10:29:53,252::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1bd43a0-0450-4d19-9e3e-495993b2e9cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-15::DEBUG::2014-08-21 10:29:53,274::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::INFO::2014-08-21 10:29:53,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:29:53,462::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700211', 'lastCheck': '11.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:29:53,463::task::1185::TaskManager.Task::(prepare) Task=`273ad807-a203-44e1-b2a6-7af53b427dbb`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700211', 'lastCheck': '11.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:29:53,464::task::595::TaskManager.Task::(_updateState) Task=`273ad807-a203-44e1-b2a6-7af53b427dbb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:29:53,464::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:29:53,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:29:53,465::task::990::TaskManager.Task::(_decref) Task=`273ad807-a203-44e1-b2a6-7af53b427dbb`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:29:53,442::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:29:53,770::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:29:53,783::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1bd43a0-0450-4d19-9e3e-495993b2e9cb`::Granted request
>Thread-34::DEBUG::2014-08-21 10:29:53,831::task::827::TaskManager.Task::(resourceAcquired) Task=`416fcbc5-e794-46dd-89ea-f22a890e8af5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:29:53,839::task::990::TaskManager.Task::(_decref) Task=`416fcbc5-e794-46dd-89ea-f22a890e8af5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:29:54,068::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:54,068::task::1185::TaskManager.Task::(prepare) Task=`416fcbc5-e794-46dd-89ea-f22a890e8af5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:29:54,069::task::595::TaskManager.Task::(_updateState) Task=`416fcbc5-e794-46dd-89ea-f22a890e8af5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:29:54,132::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:29:54,160::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 10:29:54,031::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0124932 s, 39.9 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:29:54,185::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:29:54,186::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:29:54,186::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:29:54,186::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:29:54,187::task::990::TaskManager.Task::(_decref) Task=`416fcbc5-e794-46dd-89ea-f22a890e8af5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:29:55,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.40352 s, 233 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:29:57,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:30:13,648::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-13::DEBUG::2014-08-21 10:30:14,160::task::595::TaskManager.Task::(_updateState) Task=`dffe2a09-ec3d-4445-9733-35c5ab41939f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:30:14,192::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:30:14,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:30:14,536::task::1185::TaskManager.Task::(prepare) Task=`dffe2a09-ec3d-4445-9733-35c5ab41939f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:30:14,537::task::595::TaskManager.Task::(_updateState) Task=`dffe2a09-ec3d-4445-9733-35c5ab41939f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:30:14,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:30:14,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:30:14,538::task::990::TaskManager.Task::(_decref) Task=`dffe2a09-ec3d-4445-9733-35c5ab41939f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:30:14,686::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-34::DEBUG::2014-08-21 10:30:14,723::task::595::TaskManager.Task::(_updateState) Task=`29b09c58-a6bd-4d4f-9188-1ae7a5a96b8c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:30:14,759::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:30:14,776::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6860367e-1415-4af7-8a42-dbae936af985`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:30:14,777::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 10:30:16,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:30:16,364::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:30:16,851::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6860367e-1415-4af7-8a42-dbae936af985`::Granted request
>Thread-34::DEBUG::2014-08-21 10:30:16,871::task::827::TaskManager.Task::(resourceAcquired) Task=`29b09c58-a6bd-4d4f-9188-1ae7a5a96b8c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:30:16,872::task::990::TaskManager.Task::(_decref) Task=`29b09c58-a6bd-4d4f-9188-1ae7a5a96b8c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:30:18,563::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:30:18,564::task::1185::TaskManager.Task::(prepare) Task=`29b09c58-a6bd-4d4f-9188-1ae7a5a96b8c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:30:18,565::task::595::TaskManager.Task::(_updateState) Task=`29b09c58-a6bd-4d4f-9188-1ae7a5a96b8c`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 10:30:18,577::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.126336 s, 3.9 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:30:18,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:30:18,731::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:30:18,744::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:30:18,789::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:30:18,795::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:30:18,797::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:30:18,805::task::990::TaskManager.Task::(_decref) Task=`29b09c58-a6bd-4d4f-9188-1ae7a5a96b8c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:30:19,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 21.2208 s, 48.3 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:30:21,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:30:21,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.095805 s, 10.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:30:23,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:30:23,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110657 s, 9.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:30:24,362::task::595::TaskManager.Task::(_updateState) Task=`58d880c3-965c-4164-96a6-a1ff0d115ec8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:30:24,362::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:30:24,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.126336', 'lastCheck': '5.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:30:24,363::task::1185::TaskManager.Task::(prepare) Task=`58d880c3-965c-4164-96a6-a1ff0d115ec8`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.126336', 'lastCheck': '5.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:30:24,363::task::595::TaskManager.Task::(_updateState) Task=`58d880c3-965c-4164-96a6-a1ff0d115ec8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:30:24,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:30:24,364::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:30:24,364::task::990::TaskManager.Task::(_decref) Task=`58d880c3-965c-4164-96a6-a1ff0d115ec8`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:30:25,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:30:27,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.90396 s, 538 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:30:28,828::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:30:28,841::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-13::DEBUG::2014-08-21 10:30:28,843::task::595::TaskManager.Task::(_updateState) Task=`0ee0fdf0-deca-438d-a6cc-7515c8ddd4d3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:30:28,843::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:30:28,843::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:30:28,844::task::1185::TaskManager.Task::(prepare) Task=`0ee0fdf0-deca-438d-a6cc-7515c8ddd4d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:30:28,844::task::595::TaskManager.Task::(_updateState) Task=`0ee0fdf0-deca-438d-a6cc-7515c8ddd4d3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:30:28,844::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:30:28,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:30:28,844::task::990::TaskManager.Task::(_decref) Task=`0ee0fdf0-deca-438d-a6cc-7515c8ddd4d3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:30:28,849::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00386391 s, 129 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:30:28,851::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-34::DEBUG::2014-08-21 10:30:28,854::task::595::TaskManager.Task::(_updateState) Task=`92ed46dd-e58a-4dc5-bfcb-fec1e5d0906f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:30:28,856::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:30:28,858::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`874880b7-630f-4b6c-a741-1975a187dfc4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:30:28,859::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:30:28,861::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:30:28,862::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`874880b7-630f-4b6c-a741-1975a187dfc4`::Granted request
>Thread-34::DEBUG::2014-08-21 10:30:28,865::task::827::TaskManager.Task::(resourceAcquired) Task=`92ed46dd-e58a-4dc5-bfcb-fec1e5d0906f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:30:28,865::task::990::TaskManager.Task::(_decref) Task=`92ed46dd-e58a-4dc5-bfcb-fec1e5d0906f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:30:28,868::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:30:28,869::task::1185::TaskManager.Task::(prepare) Task=`92ed46dd-e58a-4dc5-bfcb-fec1e5d0906f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:30:28,869::task::595::TaskManager.Task::(_updateState) Task=`92ed46dd-e58a-4dc5-bfcb-fec1e5d0906f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:30:28,869::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:30:28,869::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:30:28,870::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:30:28,870::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:30:28,870::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:30:28,870::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:30:28,871::task::990::TaskManager.Task::(_decref) Task=`92ed46dd-e58a-4dc5-bfcb-fec1e5d0906f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:30:29,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:30:30,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.097332 s, 10.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:30:32,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:30:35,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.07768 s, 333 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:30:37,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:30:37,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0741052 s, 13.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:30:38,893::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-13::DEBUG::2014-08-21 10:30:38,894::task::595::TaskManager.Task::(_updateState) Task=`7c621008-777d-4bc0-bd3f-4ccea7634bb5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:30:38,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:30:38,896::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:30:38,896::task::1185::TaskManager.Task::(prepare) Task=`7c621008-777d-4bc0-bd3f-4ccea7634bb5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:30:38,897::task::595::TaskManager.Task::(_updateState) Task=`7c621008-777d-4bc0-bd3f-4ccea7634bb5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:30:38,904::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:30:38,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:30:38,905::task::990::TaskManager.Task::(_decref) Task=`7c621008-777d-4bc0-bd3f-4ccea7634bb5`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:30:38,964::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:30:39,396::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 10:30:39,474::task::595::TaskManager.Task::(_updateState) Task=`76041cf1-efa5-4084-9e94-335d491d6dd7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:30:39,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:30:39,571::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a256a784-1555-4871-83b3-86cb62a084a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:30:39,581::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Dummy-33::DEBUG::2014-08-21 10:30:40,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:30:40,431::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0134069 s, 37.1 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:30:40,591::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:30:40,592::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a256a784-1555-4871-83b3-86cb62a084a1`::Granted request
>Thread-34::DEBUG::2014-08-21 10:30:40,595::task::827::TaskManager.Task::(resourceAcquired) Task=`76041cf1-efa5-4084-9e94-335d491d6dd7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:30:40,596::task::990::TaskManager.Task::(_decref) Task=`76041cf1-efa5-4084-9e94-335d491d6dd7`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:30:40,693::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:30:40,694::task::1185::TaskManager.Task::(prepare) Task=`76041cf1-efa5-4084-9e94-335d491d6dd7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:30:40,700::task::595::TaskManager.Task::(_updateState) Task=`76041cf1-efa5-4084-9e94-335d491d6dd7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:30:40,714::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:30:40,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:30:40,716::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:30:40,717::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:30:40,876::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:30:40,876::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:30:40,877::task::990::TaskManager.Task::(_decref) Task=`76041cf1-efa5-4084-9e94-335d491d6dd7`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:30:41,194::task::595::TaskManager.Task::(_updateState) Task=`e10714a7-b10d-460c-95d4-aab136eaf0e0`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:30:41,205::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:30:41,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00386391', 'lastCheck': '12.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:30:41,206::task::1185::TaskManager.Task::(prepare) Task=`e10714a7-b10d-460c-95d4-aab136eaf0e0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00386391', 'lastCheck': '12.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:30:41,206::task::595::TaskManager.Task::(_updateState) Task=`e10714a7-b10d-460c-95d4-aab136eaf0e0`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:30:41,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:30:41,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:30:41,207::task::990::TaskManager.Task::(_decref) Task=`e10714a7-b10d-460c-95d4-aab136eaf0e0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:30:41,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.25236 s, 818 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:30:43,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:30:43,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.138339 s, 7.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:30:45,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:30:47,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.19774 s, 855 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:30:49,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:30:49,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0713707 s, 14.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:30:51,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:31:03,779::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-13::DEBUG::2014-08-21 10:31:03,914::task::595::TaskManager.Task::(_updateState) Task=`fdb381e6-28dd-4872-812c-4822438801a4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:31:04,120::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:31:04,142::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:31:04,143::task::1185::TaskManager.Task::(prepare) Task=`fdb381e6-28dd-4872-812c-4822438801a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:31:04,143::task::595::TaskManager.Task::(_updateState) Task=`fdb381e6-28dd-4872-812c-4822438801a4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:31:04,144::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:31:04,144::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:31:04,145::task::990::TaskManager.Task::(_decref) Task=`fdb381e6-28dd-4872-812c-4822438801a4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:31:04,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-34::DEBUG::2014-08-21 10:31:04,274::task::595::TaskManager.Task::(_updateState) Task=`aab589ca-7c9d-46c6-bf39-cf0810f2d102`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:31:04,275::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:31:04,281::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5af749fb-139d-4e8d-b951-cb45137f9892`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:31:04,284::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:31:04,290::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:31:04,293::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5af749fb-139d-4e8d-b951-cb45137f9892`::Granted request
>Thread-34::DEBUG::2014-08-21 10:31:04,302::task::827::TaskManager.Task::(resourceAcquired) Task=`aab589ca-7c9d-46c6-bf39-cf0810f2d102`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:31:04,308::task::990::TaskManager.Task::(_decref) Task=`aab589ca-7c9d-46c6-bf39-cf0810f2d102`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:31:04,379::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:04,382::task::1185::TaskManager.Task::(prepare) Task=`aab589ca-7c9d-46c6-bf39-cf0810f2d102`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:04,386::task::595::TaskManager.Task::(_updateState) Task=`aab589ca-7c9d-46c6-bf39-cf0810f2d102`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:31:04,387::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:31:04,391::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:31:04,395::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:31:04,398::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:31:04,401::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:31:04,405::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:31:04,410::task::990::TaskManager.Task::(_decref) Task=`aab589ca-7c9d-46c6-bf39-cf0810f2d102`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:31:04,487::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:31:04,622::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00414492 s, 120 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:04,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 13.531 s, 75.7 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:31:06,854::task::595::TaskManager.Task::(_updateState) Task=`fbbb585d-c96e-434d-aec4-8577600f9490`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:31:06,854::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:31:06,854::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00414492', 'lastCheck': '2.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:31:06,855::task::1185::TaskManager.Task::(prepare) Task=`fbbb585d-c96e-434d-aec4-8577600f9490`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00414492', 'lastCheck': '2.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:31:06,855::task::595::TaskManager.Task::(_updateState) Task=`fbbb585d-c96e-434d-aec4-8577600f9490`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:31:06,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:31:06,855::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:31:06,855::task::990::TaskManager.Task::(_decref) Task=`fbbb585d-c96e-434d-aec4-8577600f9490`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:31:06,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:07,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0836669 s, 12.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:09,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:09,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0952753 s, 10.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:11,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:13,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.211067 s, 4.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:31:14,439::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-13::DEBUG::2014-08-21 10:31:14,442::task::595::TaskManager.Task::(_updateState) Task=`c625e8d4-7ac0-4bc1-b0aa-2d3cf9bdf48d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:31:14,443::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:31:14,444::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:31:14,445::task::1185::TaskManager.Task::(prepare) Task=`c625e8d4-7ac0-4bc1-b0aa-2d3cf9bdf48d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:31:14,445::task::595::TaskManager.Task::(_updateState) Task=`c625e8d4-7ac0-4bc1-b0aa-2d3cf9bdf48d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:31:14,446::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:31:14,446::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:31:14,446::task::990::TaskManager.Task::(_decref) Task=`c625e8d4-7ac0-4bc1-b0aa-2d3cf9bdf48d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:31:14,455::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-34::DEBUG::2014-08-21 10:31:14,456::task::595::TaskManager.Task::(_updateState) Task=`d11731f6-9668-40a2-b960-150733d28d8f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:31:14,456::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:31:14,458::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5bd3a8b7-2d91-4c90-95a1-ff286d5d6912`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:31:14,458::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:31:14,459::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:31:14,459::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5bd3a8b7-2d91-4c90-95a1-ff286d5d6912`::Granted request
>Thread-34::DEBUG::2014-08-21 10:31:14,460::task::827::TaskManager.Task::(resourceAcquired) Task=`d11731f6-9668-40a2-b960-150733d28d8f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:31:14,460::task::990::TaskManager.Task::(_decref) Task=`d11731f6-9668-40a2-b960-150733d28d8f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:31:14,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:14,467::task::1185::TaskManager.Task::(prepare) Task=`d11731f6-9668-40a2-b960-150733d28d8f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:14,468::task::595::TaskManager.Task::(_updateState) Task=`d11731f6-9668-40a2-b960-150733d28d8f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:31:14,468::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:31:14,468::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:31:14,469::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:31:14,469::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:31:14,469::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:31:14,470::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:31:14,470::task::990::TaskManager.Task::(_decref) Task=`d11731f6-9668-40a2-b960-150733d28d8f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:31:14,720::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:31:14,745::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000774271 s, 643 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:15,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:15,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0814536 s, 12.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:17,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:21,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.21011 s, 319 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:23,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:31:24,720::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-26::DEBUG::2014-08-21 10:31:24,722::task::595::TaskManager.Task::(_updateState) Task=`211ff3e2-76e8-4cd7-8f00-d8640e26000c`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 10:31:24,839::task::595::TaskManager.Task::(_updateState) Task=`4bdca35d-c31e-45cf-9834-f00d8d1e8bbe`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:31:25,033::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:31:25,033::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:31:25,034::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774271', 'lastCheck': '10.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:31:25,035::task::1185::TaskManager.Task::(prepare) Task=`4bdca35d-c31e-45cf-9834-f00d8d1e8bbe`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774271', 'lastCheck': '10.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:31:25,035::task::595::TaskManager.Task::(_updateState) Task=`4bdca35d-c31e-45cf-9834-f00d8d1e8bbe`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:31:25,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:31:25,036::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:31:25,083::task::990::TaskManager.Task::(_decref) Task=`4bdca35d-c31e-45cf-9834-f00d8d1e8bbe`::ref 0 aborting False
>Thread-26::INFO::2014-08-21 10:31:25,280::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:31:25,280::task::1185::TaskManager.Task::(prepare) Task=`211ff3e2-76e8-4cd7-8f00-d8640e26000c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:31:25,281::task::595::TaskManager.Task::(_updateState) Task=`211ff3e2-76e8-4cd7-8f00-d8640e26000c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:31:25,281::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:31:25,282::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:31:25,289::task::990::TaskManager.Task::(_decref) Task=`211ff3e2-76e8-4cd7-8f00-d8640e26000c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:31:26,905::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-34::DEBUG::2014-08-21 10:31:26,917::task::595::TaskManager.Task::(_updateState) Task=`e85c1080-fff8-45d2-b562-f9315280e073`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:31:27,095::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:31:27,097::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`756c0143-fcc9-4e9c-800e-cecde7b9016d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:31:27,097::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:31:27,098::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:31:27,098::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`756c0143-fcc9-4e9c-800e-cecde7b9016d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:31:27,099::task::827::TaskManager.Task::(resourceAcquired) Task=`e85c1080-fff8-45d2-b562-f9315280e073`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:31:27,099::task::990::TaskManager.Task::(_decref) Task=`e85c1080-fff8-45d2-b562-f9315280e073`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:31:27,109::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:31:27,155::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:27,155::task::1185::TaskManager.Task::(prepare) Task=`e85c1080-fff8-45d2-b562-f9315280e073`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:27,156::task::595::TaskManager.Task::(_updateState) Task=`e85c1080-fff8-45d2-b562-f9315280e073`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:31:27,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:31:27,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:31:27,157::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:31:27,157::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:31:27,158::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:31:27,158::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:31:27,158::task::990::TaskManager.Task::(_decref) Task=`e85c1080-fff8-45d2-b562-f9315280e073`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:31:27,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.11312 s, 249 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:31:27,736::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0782994 s, 6.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:29,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:37,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.7476 s, 178 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:31:37,931::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-13::DEBUG::2014-08-21 10:31:37,937::task::595::TaskManager.Task::(_updateState) Task=`d913d69d-cd2b-43c6-ab17-d141e8fdf07b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:31:37,939::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:31:37,944::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:31:37,946::task::1185::TaskManager.Task::(prepare) Task=`d913d69d-cd2b-43c6-ab17-d141e8fdf07b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:31:37,948::task::595::TaskManager.Task::(_updateState) Task=`d913d69d-cd2b-43c6-ab17-d141e8fdf07b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:31:37,950::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:31:37,951::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:31:37,953::task::990::TaskManager.Task::(_decref) Task=`d913d69d-cd2b-43c6-ab17-d141e8fdf07b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:31:37,957::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:31:38,315::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-34::DEBUG::2014-08-21 10:31:38,316::task::595::TaskManager.Task::(_updateState) Task=`d4d9fb4b-4b48-4ffb-b739-121994a9cfb5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:31:38,317::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:31:38,318::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bdad2bc5-49a8-4217-86d4-c39f72cfb66d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:31:38,319::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:31:38,320::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:31:38,321::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bdad2bc5-49a8-4217-86d4-c39f72cfb66d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:31:38,349::task::827::TaskManager.Task::(resourceAcquired) Task=`d4d9fb4b-4b48-4ffb-b739-121994a9cfb5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:31:38,351::task::990::TaskManager.Task::(_decref) Task=`d4d9fb4b-4b48-4ffb-b739-121994a9cfb5`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:31:38,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0092139 s, 54.0 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:31:38,405::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:38,405::task::1185::TaskManager.Task::(prepare) Task=`d4d9fb4b-4b48-4ffb-b739-121994a9cfb5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:38,405::task::595::TaskManager.Task::(_updateState) Task=`d4d9fb4b-4b48-4ffb-b739-121994a9cfb5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:31:38,405::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:31:38,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:31:38,406::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:31:38,420::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:31:38,421::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:31:38,421::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:31:38,424::task::990::TaskManager.Task::(_decref) Task=`d4d9fb4b-4b48-4ffb-b739-121994a9cfb5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:31:39,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:42,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.39588 s, 427 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:45,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:46,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.144922 s, 7.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:31:47,285::task::595::TaskManager.Task::(_updateState) Task=`1bc588bf-cd5d-4817-8b7e-4acdc81781c3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:31:47,288::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:31:47,289::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0092139', 'lastCheck': '8.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:31:47,290::task::1185::TaskManager.Task::(prepare) Task=`1bc588bf-cd5d-4817-8b7e-4acdc81781c3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0092139', 'lastCheck': '8.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:31:47,293::task::595::TaskManager.Task::(_updateState) Task=`1bc588bf-cd5d-4817-8b7e-4acdc81781c3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:31:47,293::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:31:47,294::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:31:47,296::task::990::TaskManager.Task::(_decref) Task=`1bc588bf-cd5d-4817-8b7e-4acdc81781c3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:31:48,438::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-13::DEBUG::2014-08-21 10:31:48,439::task::595::TaskManager.Task::(_updateState) Task=`0a55a2aa-d792-49f4-97b2-4463ca6f43a5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:31:48,440::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:31:48,441::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:31:48,441::task::1185::TaskManager.Task::(prepare) Task=`0a55a2aa-d792-49f4-97b2-4463ca6f43a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:31:48,441::task::595::TaskManager.Task::(_updateState) Task=`0a55a2aa-d792-49f4-97b2-4463ca6f43a5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:31:48,441::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:31:48,442::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:31:48,442::task::990::TaskManager.Task::(_decref) Task=`0a55a2aa-d792-49f4-97b2-4463ca6f43a5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:31:48,446::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-34::DEBUG::2014-08-21 10:31:48,447::task::595::TaskManager.Task::(_updateState) Task=`cf58aeac-6757-45f8-bf92-bf9b5eb8c156`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:31:48,447::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:31:48,448::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`32a237cb-2e41-4f19-8074-41f065cbc47d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:31:48,448::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:31:48,449::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:31:48,449::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`32a237cb-2e41-4f19-8074-41f065cbc47d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:31:48,451::task::827::TaskManager.Task::(resourceAcquired) Task=`cf58aeac-6757-45f8-bf92-bf9b5eb8c156`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:31:48,451::task::990::TaskManager.Task::(_decref) Task=`cf58aeac-6757-45f8-bf92-bf9b5eb8c156`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:31:48,456::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:48,457::task::1185::TaskManager.Task::(prepare) Task=`cf58aeac-6757-45f8-bf92-bf9b5eb8c156`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:31:48,457::task::595::TaskManager.Task::(_updateState) Task=`cf58aeac-6757-45f8-bf92-bf9b5eb8c156`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:31:48,457::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:31:48,457::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:31:48,458::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:31:48,458::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:31:48,458::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:31:48,459::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:31:48,459::task::990::TaskManager.Task::(_decref) Task=`cf58aeac-6757-45f8-bf92-bf9b5eb8c156`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:31:48,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:49,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.136542 s, 7.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:31:49,210::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:31:49,223::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00121476 s, 410 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:51,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:31:55,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.77923 s, 214 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:31:57,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:32:01,865::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-13::DEBUG::2014-08-21 10:32:02,276::task::595::TaskManager.Task::(_updateState) Task=`1c07ba29-2dae-4798-9b7e-a95d30fa4735`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:32:02,544::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:32:03,549::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:32:03,724::task::1185::TaskManager.Task::(prepare) Task=`1c07ba29-2dae-4798-9b7e-a95d30fa4735`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:32:03,728::task::595::TaskManager.Task::(_updateState) Task=`1c07ba29-2dae-4798-9b7e-a95d30fa4735`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:32:03,731::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:32:03,733::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:32:03,755::task::990::TaskManager.Task::(_decref) Task=`1c07ba29-2dae-4798-9b7e-a95d30fa4735`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:32:03,974::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:32:08,307::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-15::DEBUG::2014-08-21 10:32:08,319::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.173573 s, 2.9 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:32:08,320::task::595::TaskManager.Task::(_updateState) Task=`7eb005b7-e5a4-4324-b572-c92f9f2a07cb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:32:08,324::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:32:08,332::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d557ec47-fdc5-462a-becc-d4ff7f513140`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:32:08,364::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:32:08,381::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:32:08,384::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d557ec47-fdc5-462a-becc-d4ff7f513140`::Granted request
>Thread-34::DEBUG::2014-08-21 10:32:08,392::task::827::TaskManager.Task::(resourceAcquired) Task=`7eb005b7-e5a4-4324-b572-c92f9f2a07cb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:32:08,395::task::990::TaskManager.Task::(_decref) Task=`7eb005b7-e5a4-4324-b572-c92f9f2a07cb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:32:08,411::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:08,411::task::1185::TaskManager.Task::(prepare) Task=`7eb005b7-e5a4-4324-b572-c92f9f2a07cb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:08,411::task::595::TaskManager.Task::(_updateState) Task=`7eb005b7-e5a4-4324-b572-c92f9f2a07cb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:32:08,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:32:08,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:32:08,412::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:32:08,412::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:32:08,412::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:32:08,412::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:32:08,413::task::990::TaskManager.Task::(_decref) Task=`7eb005b7-e5a4-4324-b572-c92f9f2a07cb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:32:08,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.0545 s, 102 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:12,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:32:12,934::task::595::TaskManager.Task::(_updateState) Task=`08b9c290-477c-4307-8632-2523373ce9f3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:32:17,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:32:17,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.173573', 'lastCheck': '9.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:32:17,871::task::1185::TaskManager.Task::(prepare) Task=`08b9c290-477c-4307-8632-2523373ce9f3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.173573', 'lastCheck': '9.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:32:17,871::task::595::TaskManager.Task::(_updateState) Task=`08b9c290-477c-4307-8632-2523373ce9f3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:32:17,872::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:32:17,872::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:32:17,872::task::990::TaskManager.Task::(_decref) Task=`08b9c290-477c-4307-8632-2523373ce9f3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:32:18,994::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-13::DEBUG::2014-08-21 10:32:19,965::task::595::TaskManager.Task::(_updateState) Task=`0e91e29f-732d-49ca-acb7-2db4b72a4fd3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:32:19,966::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:32:19,967::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-15::DEBUG::2014-08-21 10:32:19,305::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:32:19,975::task::1185::TaskManager.Task::(prepare) Task=`0e91e29f-732d-49ca-acb7-2db4b72a4fd3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:32:20,124::task::595::TaskManager.Task::(_updateState) Task=`0e91e29f-732d-49ca-acb7-2db4b72a4fd3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:32:20,124::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:32:20,125::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:32:20,126::task::990::TaskManager.Task::(_decref) Task=`0e91e29f-732d-49ca-acb7-2db4b72a4fd3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:32:20,313::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00768621 s, 64.8 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:32:20,473::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-34::DEBUG::2014-08-21 10:32:20,475::task::595::TaskManager.Task::(_updateState) Task=`b3b5febe-173a-419e-862b-2898af959a7c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:32:20,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:32:20,500::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8f289945-4875-4d0b-83ba-963a83754056`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:32:20,504::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:32:20,525::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:32:20,526::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8f289945-4875-4d0b-83ba-963a83754056`::Granted request
>Thread-34::DEBUG::2014-08-21 10:32:20,803::task::827::TaskManager.Task::(resourceAcquired) Task=`b3b5febe-173a-419e-862b-2898af959a7c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:32:20,848::task::990::TaskManager.Task::(_decref) Task=`b3b5febe-173a-419e-862b-2898af959a7c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:32:20,946::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:20,947::task::1185::TaskManager.Task::(prepare) Task=`b3b5febe-173a-419e-862b-2898af959a7c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:20,948::task::595::TaskManager.Task::(_updateState) Task=`b3b5febe-173a-419e-862b-2898af959a7c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:32:20,949::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:32:20,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:32:20,950::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:32:20,960::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:32:20,962::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:32:20,990::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:32:21,001::task::990::TaskManager.Task::(_decref) Task=`b3b5febe-173a-419e-862b-2898af959a7c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:32:21,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.34233 s, 123 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:23,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:23,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105094 s, 9.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:25,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:25,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0798439 s, 12.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:27,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:28,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0830983 s, 12.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:30,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:30,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899291 s, 11.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:32:31,289::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:32:31,311::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000963386 s, 517 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:32:31,388::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-26::DEBUG::2014-08-21 10:32:31,389::task::595::TaskManager.Task::(_updateState) Task=`a38fa389-711b-49a0-b75b-6ff026777cf1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:32:31,390::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:32:31,390::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:32:31,391::task::1185::TaskManager.Task::(prepare) Task=`a38fa389-711b-49a0-b75b-6ff026777cf1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:32:31,391::task::595::TaskManager.Task::(_updateState) Task=`a38fa389-711b-49a0-b75b-6ff026777cf1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:32:31,391::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:32:31,391::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:32:31,391::task::990::TaskManager.Task::(_decref) Task=`a38fa389-711b-49a0-b75b-6ff026777cf1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:32:31,396::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-34::DEBUG::2014-08-21 10:32:31,397::task::595::TaskManager.Task::(_updateState) Task=`ce52e5fc-8c10-42cf-92c5-98dae768c3c5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:32:31,397::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:32:31,397::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9b24a39b-99d5-46a1-b59e-85950efce6ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:32:31,398::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:32:31,398::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:32:31,398::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9b24a39b-99d5-46a1-b59e-85950efce6ce`::Granted request
>Thread-34::DEBUG::2014-08-21 10:32:31,399::task::827::TaskManager.Task::(resourceAcquired) Task=`ce52e5fc-8c10-42cf-92c5-98dae768c3c5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:32:31,399::task::990::TaskManager.Task::(_decref) Task=`ce52e5fc-8c10-42cf-92c5-98dae768c3c5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:32:31,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:31,403::task::1185::TaskManager.Task::(prepare) Task=`ce52e5fc-8c10-42cf-92c5-98dae768c3c5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:31,403::task::595::TaskManager.Task::(_updateState) Task=`ce52e5fc-8c10-42cf-92c5-98dae768c3c5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:32:31,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:32:31,404::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:32:31,404::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:32:31,405::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:32:31,405::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:32:31,405::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:32:31,406::task::990::TaskManager.Task::(_decref) Task=`ce52e5fc-8c10-42cf-92c5-98dae768c3c5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:32:32,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:32,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107858 s, 9.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:34,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:35,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.241609 s, 4.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:32:35,524::task::595::TaskManager.Task::(_updateState) Task=`2a0f2d38-98d3-4d69-8bb2-26c1bdc78157`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:32:35,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:32:35,525::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000963386', 'lastCheck': '4.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:32:35,526::task::1185::TaskManager.Task::(prepare) Task=`2a0f2d38-98d3-4d69-8bb2-26c1bdc78157`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000963386', 'lastCheck': '4.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:32:35,526::task::595::TaskManager.Task::(_updateState) Task=`2a0f2d38-98d3-4d69-8bb2-26c1bdc78157`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:32:35,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:32:35,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:32:35,527::task::990::TaskManager.Task::(_decref) Task=`2a0f2d38-98d3-4d69-8bb2-26c1bdc78157`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:32:37,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:37,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.07253 s, 14.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:39,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:40,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.494131 s, 2.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:32:41,330::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:32:41,347::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000632389 s, 787 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:32:41,426::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-26::DEBUG::2014-08-21 10:32:41,427::task::595::TaskManager.Task::(_updateState) Task=`45d463ef-4b87-4952-9896-f2fdeca494e8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:32:41,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:32:41,429::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:32:41,429::task::1185::TaskManager.Task::(prepare) Task=`45d463ef-4b87-4952-9896-f2fdeca494e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:32:41,429::task::595::TaskManager.Task::(_updateState) Task=`45d463ef-4b87-4952-9896-f2fdeca494e8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:32:41,430::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:32:41,430::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:32:41,430::task::990::TaskManager.Task::(_decref) Task=`45d463ef-4b87-4952-9896-f2fdeca494e8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:32:41,435::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 10:32:41,435::task::595::TaskManager.Task::(_updateState) Task=`c02281ce-a0eb-40e5-913b-c67cee9f8ed6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:32:41,436::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:32:41,436::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1eb9f3e2-8eb2-4c63-acc8-33641ee1b9da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:32:41,437::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:32:41,437::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:32:41,437::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1eb9f3e2-8eb2-4c63-acc8-33641ee1b9da`::Granted request
>Thread-34::DEBUG::2014-08-21 10:32:41,438::task::827::TaskManager.Task::(resourceAcquired) Task=`c02281ce-a0eb-40e5-913b-c67cee9f8ed6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:32:41,438::task::990::TaskManager.Task::(_decref) Task=`c02281ce-a0eb-40e5-913b-c67cee9f8ed6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:32:41,442::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:41,443::task::1185::TaskManager.Task::(prepare) Task=`c02281ce-a0eb-40e5-913b-c67cee9f8ed6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:41,443::task::595::TaskManager.Task::(_updateState) Task=`c02281ce-a0eb-40e5-913b-c67cee9f8ed6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:32:41,443::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:32:41,443::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:32:41,444::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:32:41,444::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:32:41,444::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:32:41,444::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:32:41,445::task::990::TaskManager.Task::(_decref) Task=`c02281ce-a0eb-40e5-913b-c67cee9f8ed6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:32:42,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:42,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0913468 s, 11.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:44,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:45,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.24572 s, 822 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:47,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:48,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.886715 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:50,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:32:52,557::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-26::DEBUG::2014-08-21 10:32:52,559::task::595::TaskManager.Task::(_updateState) Task=`5bbb36e5-2cc2-4dae-acae-39dac737010c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:32:52,559::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:32:52,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:32:52,620::task::1185::TaskManager.Task::(prepare) Task=`5bbb36e5-2cc2-4dae-acae-39dac737010c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:32:52,625::task::595::TaskManager.Task::(_updateState) Task=`e7216bbf-37a7-489a-a50e-fee5cc6e559a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:32:52,643::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::DEBUG::2014-08-21 10:32:52,631::task::595::TaskManager.Task::(_updateState) Task=`5bbb36e5-2cc2-4dae-acae-39dac737010c`::moving from state preparing -> state finished
>Thread-13::INFO::2014-08-21 10:32:52,653::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632389', 'lastCheck': '11.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:32:52,655::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-15::DEBUG::2014-08-21 10:32:52,695::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:32:52,719::task::1185::TaskManager.Task::(prepare) Task=`e7216bbf-37a7-489a-a50e-fee5cc6e559a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632389', 'lastCheck': '11.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:32:52,733::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:32:52,770::task::990::TaskManager.Task::(_decref) Task=`5bbb36e5-2cc2-4dae-acae-39dac737010c`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:32:52,779::task::595::TaskManager.Task::(_updateState) Task=`e7216bbf-37a7-489a-a50e-fee5cc6e559a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:32:52,781::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:32:52,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:32:52,820::task::990::TaskManager.Task::(_decref) Task=`e7216bbf-37a7-489a-a50e-fee5cc6e559a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:32:52,839::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-34::DEBUG::2014-08-21 10:32:52,867::task::595::TaskManager.Task::(_updateState) Task=`21d353f5-d3b2-4e4b-927d-68e129e9a5a6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:32:52,886::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:32:52,950::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3f039e5a-79d2-4667-80c1-e4cd6943fa35`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-15::DEBUG::2014-08-21 10:32:52,950::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0051937 s, 95.9 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:32:52,973::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:32:53,036::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:32:53,046::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3f039e5a-79d2-4667-80c1-e4cd6943fa35`::Granted request
>Thread-34::DEBUG::2014-08-21 10:32:53,098::task::827::TaskManager.Task::(resourceAcquired) Task=`21d353f5-d3b2-4e4b-927d-68e129e9a5a6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:32:53,103::task::990::TaskManager.Task::(_decref) Task=`21d353f5-d3b2-4e4b-927d-68e129e9a5a6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:32:53,231::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:53,233::task::1185::TaskManager.Task::(prepare) Task=`21d353f5-d3b2-4e4b-927d-68e129e9a5a6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:32:53,234::task::595::TaskManager.Task::(_updateState) Task=`21d353f5-d3b2-4e4b-927d-68e129e9a5a6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:32:53,236::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:32:53,238::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:32:53,241::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:32:53,244::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:32:53,246::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:32:53,248::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:32:53,251::task::990::TaskManager.Task::(_decref) Task=`21d353f5-d3b2-4e4b-927d-68e129e9a5a6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:32:53,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.37333 s, 431 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:55,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:55,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.061817 s, 16.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:32:57,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:32:58,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.552217 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:00,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:00,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0732541 s, 14.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:02,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:02,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.056266 s, 18.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:33:03,545::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-13::DEBUG::2014-08-21 10:33:03,833::task::595::TaskManager.Task::(_updateState) Task=`aad5a870-ffba-4393-abef-02c55b611cc1`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 10:33:03,845::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::INFO::2014-08-21 10:33:04,027::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:33:04,182::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00183499 s, 271 kB/s\n'; <rc> = 0
>Thread-13::INFO::2014-08-21 10:33:04,315::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:04,316::task::1185::TaskManager.Task::(prepare) Task=`aad5a870-ffba-4393-abef-02c55b611cc1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:04,317::task::595::TaskManager.Task::(_updateState) Task=`aad5a870-ffba-4393-abef-02c55b611cc1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:33:04,317::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:33:07,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:33:07,542::task::990::TaskManager.Task::(_decref) Task=`aad5a870-ffba-4393-abef-02c55b611cc1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:07,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:33:07,672::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-34::DEBUG::2014-08-21 10:33:07,679::task::595::TaskManager.Task::(_updateState) Task=`cac41b27-98db-48f3-9d11-6932ad37b9fa`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:33:07,684::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:33:07,693::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e9dcd485-b339-44da-bc42-05c463b95830`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:33:07,695::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:33:07,698::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:33:07,702::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e9dcd485-b339-44da-bc42-05c463b95830`::Granted request
>Thread-34::DEBUG::2014-08-21 10:33:07,711::task::827::TaskManager.Task::(resourceAcquired) Task=`cac41b27-98db-48f3-9d11-6932ad37b9fa`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:33:07,712::task::990::TaskManager.Task::(_decref) Task=`cac41b27-98db-48f3-9d11-6932ad37b9fa`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:33:07,744::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:07,748::task::1185::TaskManager.Task::(prepare) Task=`cac41b27-98db-48f3-9d11-6932ad37b9fa`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:07,753::task::595::TaskManager.Task::(_updateState) Task=`cac41b27-98db-48f3-9d11-6932ad37b9fa`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:33:07,757::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:33:07,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:33:07,763::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:33:07,776::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:33:07,779::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:33:07,781::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:33:07,786::task::990::TaskManager.Task::(_decref) Task=`cac41b27-98db-48f3-9d11-6932ad37b9fa`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:08,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.384956 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:10,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:33:10,849::task::595::TaskManager.Task::(_updateState) Task=`35ece9a3-39a2-4db6-92d0-2418f9a367f9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:33:10,851::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:33:10,862::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00183499', 'lastCheck': '3.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:33:10,864::task::1185::TaskManager.Task::(prepare) Task=`35ece9a3-39a2-4db6-92d0-2418f9a367f9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00183499', 'lastCheck': '3.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:33:10,865::task::595::TaskManager.Task::(_updateState) Task=`35ece9a3-39a2-4db6-92d0-2418f9a367f9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:33:10,866::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:33:10,867::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:33:10,868::task::990::TaskManager.Task::(_decref) Task=`35ece9a3-39a2-4db6-92d0-2418f9a367f9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:10,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.698588 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:12,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:13,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.251714 s, 4.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:15,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:16,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.153434 s, 6.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:33:17,655::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:33:17,666::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:33:17,668::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:33:17,680::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:33:17,683::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:33:17,683::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:33:17,683::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 10:33:17,694::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:33:17,709::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00057185 s, 871 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:33:17,836::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-13::DEBUG::2014-08-21 10:33:17,837::task::595::TaskManager.Task::(_updateState) Task=`997f1980-2a43-4f59-96b9-b1572b5bbf7e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:33:17,838::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:33:17,838::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:17,838::task::1185::TaskManager.Task::(prepare) Task=`997f1980-2a43-4f59-96b9-b1572b5bbf7e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:17,839::task::595::TaskManager.Task::(_updateState) Task=`997f1980-2a43-4f59-96b9-b1572b5bbf7e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:33:17,839::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:33:17,839::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:33:17,839::task::990::TaskManager.Task::(_decref) Task=`997f1980-2a43-4f59-96b9-b1572b5bbf7e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:33:17,845::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-34::DEBUG::2014-08-21 10:33:17,846::task::595::TaskManager.Task::(_updateState) Task=`dfe8f0f0-6e04-4d67-aa65-a3e16fb16ab9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:33:17,846::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:33:17,847::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d24417e5-adb0-4193-b7a0-d532bf4b6f6b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:33:17,848::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:33:17,848::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:33:17,848::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d24417e5-adb0-4193-b7a0-d532bf4b6f6b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:33:17,849::task::827::TaskManager.Task::(resourceAcquired) Task=`dfe8f0f0-6e04-4d67-aa65-a3e16fb16ab9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:33:17,849::task::990::TaskManager.Task::(_decref) Task=`dfe8f0f0-6e04-4d67-aa65-a3e16fb16ab9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:33:17,864::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:17,865::task::1185::TaskManager.Task::(prepare) Task=`dfe8f0f0-6e04-4d67-aa65-a3e16fb16ab9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:17,865::task::595::TaskManager.Task::(_updateState) Task=`dfe8f0f0-6e04-4d67-aa65-a3e16fb16ab9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:33:17,865::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:33:17,866::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:33:17,866::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:33:17,867::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:33:17,867::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:33:17,867::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:33:17,868::task::990::TaskManager.Task::(_decref) Task=`dfe8f0f0-6e04-4d67-aa65-a3e16fb16ab9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:18,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:18,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.1069 s, 9.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:20,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:20,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111275 s, 9.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:22,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:22,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0686931 s, 14.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:24,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:33:26,202::task::595::TaskManager.Task::(_updateState) Task=`8e4eff00-03cc-4e43-ae9c-0dff20f1d304`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:33:26,203::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:33:26,204::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057185', 'lastCheck': '8.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:33:26,204::task::1185::TaskManager.Task::(prepare) Task=`8e4eff00-03cc-4e43-ae9c-0dff20f1d304`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057185', 'lastCheck': '8.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:33:26,204::task::595::TaskManager.Task::(_updateState) Task=`8e4eff00-03cc-4e43-ae9c-0dff20f1d304`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:33:26,205::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:33:26,205::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:33:26,205::task::990::TaskManager.Task::(_decref) Task=`8e4eff00-03cc-4e43-ae9c-0dff20f1d304`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:27,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.82617 s, 561 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:33:27,801::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:33:29,159::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0197773 s, 25.2 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:33:29,314::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-13::DEBUG::2014-08-21 10:33:29,315::task::595::TaskManager.Task::(_updateState) Task=`8e4c231b-6c11-42b7-8f01-a7511af8a11f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:33:29,316::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:33:29,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:29,448::task::1185::TaskManager.Task::(prepare) Task=`8e4c231b-6c11-42b7-8f01-a7511af8a11f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:29,449::task::595::TaskManager.Task::(_updateState) Task=`8e4c231b-6c11-42b7-8f01-a7511af8a11f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:33:29,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:33:29,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:33:29,450::task::990::TaskManager.Task::(_decref) Task=`8e4c231b-6c11-42b7-8f01-a7511af8a11f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:33:29,770::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Dummy-33::DEBUG::2014-08-21 10:33:29,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:33:30,166::task::595::TaskManager.Task::(_updateState) Task=`74159ffe-97f4-489f-9aaa-4818310ac29d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:33:30,197::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:33:30,200::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`57d3426d-c1b6-4afa-a021-a6729f3bd46c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:33:30,202::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:33:30,204::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:33:30,204::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`57d3426d-c1b6-4afa-a021-a6729f3bd46c`::Granted request
>Thread-34::DEBUG::2014-08-21 10:33:30,207::task::827::TaskManager.Task::(resourceAcquired) Task=`74159ffe-97f4-489f-9aaa-4818310ac29d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:33:30,208::task::990::TaskManager.Task::(_decref) Task=`74159ffe-97f4-489f-9aaa-4818310ac29d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:33:30,238::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:30,242::task::1185::TaskManager.Task::(prepare) Task=`74159ffe-97f4-489f-9aaa-4818310ac29d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:30,244::task::595::TaskManager.Task::(_updateState) Task=`74159ffe-97f4-489f-9aaa-4818310ac29d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:33:30,246::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:33:30,250::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:33:30,254::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:33:30,257::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:33:30,259::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:33:30,261::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:33:30,264::task::990::TaskManager.Task::(_decref) Task=`74159ffe-97f4-489f-9aaa-4818310ac29d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:30,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.219011 s, 4.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:32,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:34,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.03928 s, 985 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:36,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:36,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0920559 s, 11.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:38,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:38,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0648877 s, 15.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:33:40,202::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:33:40,242::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00684218 s, 72.8 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:33:40,297::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-13::DEBUG::2014-08-21 10:33:40,298::task::595::TaskManager.Task::(_updateState) Task=`c1664fc8-b809-4f7b-b0b4-fefcd31e6001`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:33:40,298::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:33:40,299::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:40,299::task::1185::TaskManager.Task::(prepare) Task=`c1664fc8-b809-4f7b-b0b4-fefcd31e6001`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:40,300::task::595::TaskManager.Task::(_updateState) Task=`c1664fc8-b809-4f7b-b0b4-fefcd31e6001`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:33:40,300::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:33:40,300::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:33:40,300::task::990::TaskManager.Task::(_decref) Task=`c1664fc8-b809-4f7b-b0b4-fefcd31e6001`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:33:40,313::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 10:33:40,315::task::595::TaskManager.Task::(_updateState) Task=`aa07bc7f-9b6d-4a07-a6b7-9c2178611a57`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:33:40,316::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:33:40,319::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d7477187-82c4-494c-a18f-136c53414f76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:33:40,319::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:33:40,321::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:33:40,322::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d7477187-82c4-494c-a18f-136c53414f76`::Granted request
>Thread-34::DEBUG::2014-08-21 10:33:40,323::task::827::TaskManager.Task::(resourceAcquired) Task=`aa07bc7f-9b6d-4a07-a6b7-9c2178611a57`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:33:40,323::task::990::TaskManager.Task::(_decref) Task=`aa07bc7f-9b6d-4a07-a6b7-9c2178611a57`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:33:40,328::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:40,328::task::1185::TaskManager.Task::(prepare) Task=`aa07bc7f-9b6d-4a07-a6b7-9c2178611a57`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:40,328::task::595::TaskManager.Task::(_updateState) Task=`aa07bc7f-9b6d-4a07-a6b7-9c2178611a57`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:33:40,329::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:33:40,329::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:33:40,329::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:33:40,330::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:33:40,330::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:33:40,330::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:33:40,331::task::990::TaskManager.Task::(_decref) Task=`aa07bc7f-9b6d-4a07-a6b7-9c2178611a57`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:40,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:40,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0605119 s, 16.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:33:42,364::task::595::TaskManager.Task::(_updateState) Task=`c8147b71-675c-44a4-9a79-9fa8e37000f1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:33:42,365::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:33:42,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00684218', 'lastCheck': '2.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:33:42,365::task::1185::TaskManager.Task::(prepare) Task=`c8147b71-675c-44a4-9a79-9fa8e37000f1`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00684218', 'lastCheck': '2.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:33:42,366::task::595::TaskManager.Task::(_updateState) Task=`c8147b71-675c-44a4-9a79-9fa8e37000f1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:33:42,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:33:42,366::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:33:42,366::task::990::TaskManager.Task::(_decref) Task=`c8147b71-675c-44a4-9a79-9fa8e37000f1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:42,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:42,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0722196 s, 14.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:44,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:45,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0696427 s, 14.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:47,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:47,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124038 s, 8.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:49,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:49,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.328597 s, 3.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:33:50,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:33:50,318::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00172662 s, 288 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:33:50,351::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d519215]
>Thread-13::DEBUG::2014-08-21 10:33:50,353::task::595::TaskManager.Task::(_updateState) Task=`c18447d9-af33-47e4-80e1-a09e4e2d1990`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:33:50,353::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:33:50,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:50,355::task::1185::TaskManager.Task::(prepare) Task=`c18447d9-af33-47e4-80e1-a09e4e2d1990`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:33:50,355::task::595::TaskManager.Task::(_updateState) Task=`c18447d9-af33-47e4-80e1-a09e4e2d1990`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:33:50,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:33:50,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:33:50,356::task::990::TaskManager.Task::(_decref) Task=`c18447d9-af33-47e4-80e1-a09e4e2d1990`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:33:50,368::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d519215]
>Thread-34::DEBUG::2014-08-21 10:33:50,369::task::595::TaskManager.Task::(_updateState) Task=`45cc6dd9-c821-4df7-9fc9-727d21a3fd2c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:33:50,369::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:33:50,370::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3653854a-b7a7-4d37-9d62-61eef2f73a7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:33:50,371::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:33:50,371::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:33:50,372::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3653854a-b7a7-4d37-9d62-61eef2f73a7c`::Granted request
>Thread-34::DEBUG::2014-08-21 10:33:50,375::task::827::TaskManager.Task::(resourceAcquired) Task=`45cc6dd9-c821-4df7-9fc9-727d21a3fd2c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:33:50,377::task::990::TaskManager.Task::(_decref) Task=`45cc6dd9-c821-4df7-9fc9-727d21a3fd2c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:33:50,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:50,391::task::1185::TaskManager.Task::(prepare) Task=`45cc6dd9-c821-4df7-9fc9-727d21a3fd2c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:33:50,392::task::595::TaskManager.Task::(_updateState) Task=`45cc6dd9-c821-4df7-9fc9-727d21a3fd2c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:33:50,392::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:33:50,393::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:33:50,394::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:33:50,394::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:33:50,394::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:33:50,395::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:33:50,395::task::990::TaskManager.Task::(_decref) Task=`45cc6dd9-c821-4df7-9fc9-727d21a3fd2c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:51,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:51,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0518354 s, 19.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:53,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:54,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580933 s, 17.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:33:56,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:33:56,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.122935 s, 8.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:33:57,529::task::595::TaskManager.Task::(_updateState) Task=`32495c76-8ce6-4249-b533-be5ecbe78d7d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:33:57,530::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:33:57,531::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00172662', 'lastCheck': '7.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:33:57,531::task::1185::TaskManager.Task::(prepare) Task=`32495c76-8ce6-4249-b533-be5ecbe78d7d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00172662', 'lastCheck': '7.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:33:57,531::task::595::TaskManager.Task::(_updateState) Task=`32495c76-8ce6-4249-b533-be5ecbe78d7d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:33:57,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:33:57,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:33:57,532::task::990::TaskManager.Task::(_decref) Task=`32495c76-8ce6-4249-b533-be5ecbe78d7d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:33:58,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:34:02,053::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:34:02,441::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-13::DEBUG::2014-08-21 10:34:02,443::task::595::TaskManager.Task::(_updateState) Task=`ede11661-6d5b-4f8e-967e-301924319760`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:34:02,444::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:34:02,446::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:34:02,446::task::1185::TaskManager.Task::(prepare) Task=`ede11661-6d5b-4f8e-967e-301924319760`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:34:02,447::task::595::TaskManager.Task::(_updateState) Task=`ede11661-6d5b-4f8e-967e-301924319760`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:34:02,454::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:34:02,455::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:34:02,456::task::990::TaskManager.Task::(_decref) Task=`ede11661-6d5b-4f8e-967e-301924319760`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:34:02,567::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 10:34:02,584::task::595::TaskManager.Task::(_updateState) Task=`4c023ce9-a923-4849-8e41-4f442da1c9a1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:34:02,729::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:34:02,759::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fdd9f4f6-6169-4da9-9964-5be81446c7b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:34:02,759::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 10:34:02,770::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00458801 s, 109 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:34:03,593::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:34:03,595::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fdd9f4f6-6169-4da9-9964-5be81446c7b1`::Granted request
>Thread-34::DEBUG::2014-08-21 10:34:03,612::task::827::TaskManager.Task::(resourceAcquired) Task=`4c023ce9-a923-4849-8e41-4f442da1c9a1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:34:03,640::task::990::TaskManager.Task::(_decref) Task=`4c023ce9-a923-4849-8e41-4f442da1c9a1`::ref 1 aborting False
>Dummy-33::DEBUG::2014-08-21 10:34:04,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.71262 s, 276 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:34:04,652::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:04,653::task::1185::TaskManager.Task::(prepare) Task=`4c023ce9-a923-4849-8e41-4f442da1c9a1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:04,653::task::595::TaskManager.Task::(_updateState) Task=`4c023ce9-a923-4849-8e41-4f442da1c9a1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:34:04,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:34:04,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:34:04,657::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:34:04,659::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:34:04,673::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:34:04,673::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:34:04,674::task::990::TaskManager.Task::(_decref) Task=`4c023ce9-a923-4849-8e41-4f442da1c9a1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:34:06,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:06,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0676834 s, 15.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:34:08,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:09,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0718268 s, 14.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:34:11,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:12,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.522518 s, 2.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:34:14,128::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:34:14,147::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00143507 s, 347 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:34:14,763::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-13::DEBUG::2014-08-21 10:34:14,764::task::595::TaskManager.Task::(_updateState) Task=`105659be-e368-499a-8aee-03742215bc0b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:34:14,765::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:34:14,766::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:34:14,766::task::1185::TaskManager.Task::(prepare) Task=`105659be-e368-499a-8aee-03742215bc0b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:34:14,766::task::595::TaskManager.Task::(_updateState) Task=`105659be-e368-499a-8aee-03742215bc0b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:34:14,767::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:34:14,767::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:34:14,767::task::990::TaskManager.Task::(_decref) Task=`105659be-e368-499a-8aee-03742215bc0b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:34:14,774::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-34::DEBUG::2014-08-21 10:34:14,775::task::595::TaskManager.Task::(_updateState) Task=`3174b52a-da27-4654-8bd7-8da610998d0c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:34:14,775::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:34:14,777::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ae759140-a760-4fb4-92e9-8f265c74ea8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:34:14,777::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:34:14,778::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:34:14,778::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ae759140-a760-4fb4-92e9-8f265c74ea8a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:34:14,779::task::827::TaskManager.Task::(resourceAcquired) Task=`3174b52a-da27-4654-8bd7-8da610998d0c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:34:14,779::task::990::TaskManager.Task::(_decref) Task=`3174b52a-da27-4654-8bd7-8da610998d0c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:34:14,811::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:14,814::task::1185::TaskManager.Task::(prepare) Task=`3174b52a-da27-4654-8bd7-8da610998d0c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:14,816::task::595::TaskManager.Task::(_updateState) Task=`3174b52a-da27-4654-8bd7-8da610998d0c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:34:14,817::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:34:14,817::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:34:14,819::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:34:14,820::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:34:14,821::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:34:14,822::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:34:14,824::task::990::TaskManager.Task::(_decref) Task=`3174b52a-da27-4654-8bd7-8da610998d0c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:34:14,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:15,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0614266 s, 16.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:34:16,504::task::595::TaskManager.Task::(_updateState) Task=`327eb77f-4259-4ec7-8708-e24f2a9fcd10`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:34:16,561::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:34:16,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143507', 'lastCheck': '2.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:34:16,562::task::1185::TaskManager.Task::(prepare) Task=`327eb77f-4259-4ec7-8708-e24f2a9fcd10`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143507', 'lastCheck': '2.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:34:16,562::task::595::TaskManager.Task::(_updateState) Task=`327eb77f-4259-4ec7-8708-e24f2a9fcd10`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:34:16,563::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:34:16,563::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:34:16,563::task::990::TaskManager.Task::(_decref) Task=`327eb77f-4259-4ec7-8708-e24f2a9fcd10`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:34:17,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:18,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.134455 s, 7.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:34:20,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:34:27,198::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-26::DEBUG::2014-08-21 10:34:27,213::task::595::TaskManager.Task::(_updateState) Task=`beb428e0-6e83-4fba-aed3-a3ab1e9f78c7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:34:27,951::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:34:27,952::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:34:27,952::task::1185::TaskManager.Task::(prepare) Task=`beb428e0-6e83-4fba-aed3-a3ab1e9f78c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:34:27,953::task::595::TaskManager.Task::(_updateState) Task=`beb428e0-6e83-4fba-aed3-a3ab1e9f78c7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:34:27,953::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:34:27,953::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:34:27,954::task::990::TaskManager.Task::(_decref) Task=`beb428e0-6e83-4fba-aed3-a3ab1e9f78c7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:34:36,982::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 10:34:36,990::task::595::TaskManager.Task::(_updateState) Task=`2742ebd2-07a3-46b4-86d4-4cedb3ce7785`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:34:36,991::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:34:36,993::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a1e81a85-5250-4071-a834-0fe5e14adac7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:34:36,995::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:34:37,009::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:34:37,010::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a1e81a85-5250-4071-a834-0fe5e14adac7`::Granted request
>Thread-34::DEBUG::2014-08-21 10:34:37,011::task::827::TaskManager.Task::(resourceAcquired) Task=`2742ebd2-07a3-46b4-86d4-4cedb3ce7785`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:34:37,030::task::990::TaskManager.Task::(_decref) Task=`2742ebd2-07a3-46b4-86d4-4cedb3ce7785`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:34:37,088::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:37,089::task::1185::TaskManager.Task::(prepare) Task=`2742ebd2-07a3-46b4-86d4-4cedb3ce7785`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:37,089::task::595::TaskManager.Task::(_updateState) Task=`2742ebd2-07a3-46b4-86d4-4cedb3ce7785`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:34:37,089::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:34:37,090::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:34:37,090::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:34:37,091::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:34:37,091::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:34:37,097::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:34:37,106::task::990::TaskManager.Task::(_decref) Task=`2742ebd2-07a3-46b4-86d4-4cedb3ce7785`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:34:37,438::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:34:38,230::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000902795 s, 552 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:34:40,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 18.0406 s, 56.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:34:42,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:42,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.118059 s, 8.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:34:43,427::task::595::TaskManager.Task::(_updateState) Task=`600af228-7001-4817-bfcd-8b293f4c6f9a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:34:43,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:34:43,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902795', 'lastCheck': '1.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:34:43,429::task::1185::TaskManager.Task::(prepare) Task=`600af228-7001-4817-bfcd-8b293f4c6f9a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902795', 'lastCheck': '1.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:34:43,429::task::595::TaskManager.Task::(_updateState) Task=`600af228-7001-4817-bfcd-8b293f4c6f9a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:34:43,430::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:34:43,430::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:34:43,439::task::990::TaskManager.Task::(_decref) Task=`600af228-7001-4817-bfcd-8b293f4c6f9a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:34:44,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:45,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0640976 s, 16.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:34:47,900::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-26::DEBUG::2014-08-21 10:34:47,902::task::595::TaskManager.Task::(_updateState) Task=`b33a552d-aa3e-4daf-8f6c-72e9f51019bb`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:34:47,902::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:34:47,903::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:34:47,904::task::1185::TaskManager.Task::(prepare) Task=`b33a552d-aa3e-4daf-8f6c-72e9f51019bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:34:47,904::task::595::TaskManager.Task::(_updateState) Task=`b33a552d-aa3e-4daf-8f6c-72e9f51019bb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:34:48,237::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:34:48,238::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:34:48,238::task::990::TaskManager.Task::(_decref) Task=`b33a552d-aa3e-4daf-8f6c-72e9f51019bb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:34:47,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:34:48,362::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-34::DEBUG::2014-08-21 10:34:48,603::task::595::TaskManager.Task::(_updateState) Task=`40071239-2563-458d-ac74-7a4864979a48`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:34:48,604::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:34:48,605::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b006ebb9-6bb5-4c51-8506-befc75967aea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:34:48,606::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:34:48,606::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:34:48,607::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b006ebb9-6bb5-4c51-8506-befc75967aea`::Granted request
>Thread-34::DEBUG::2014-08-21 10:34:48,608::task::827::TaskManager.Task::(resourceAcquired) Task=`40071239-2563-458d-ac74-7a4864979a48`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:34:48,609::task::990::TaskManager.Task::(_decref) Task=`40071239-2563-458d-ac74-7a4864979a48`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:34:48,618::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:48,619::task::1185::TaskManager.Task::(prepare) Task=`40071239-2563-458d-ac74-7a4864979a48`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:48,620::task::595::TaskManager.Task::(_updateState) Task=`40071239-2563-458d-ac74-7a4864979a48`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:34:48,620::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:34:48,620::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:34:48,622::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:34:48,622::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:34:48,622::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:34:48,623::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:34:48,623::task::990::TaskManager.Task::(_decref) Task=`40071239-2563-458d-ac74-7a4864979a48`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:34:48,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.37496 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:34:50,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:52,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.647803 s, 1.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:34:52,686::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:34:52,784::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00437167 s, 114 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:34:57,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:57,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0524737 s, 19.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:34:58,651::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-26::DEBUG::2014-08-21 10:34:58,653::task::595::TaskManager.Task::(_updateState) Task=`8395bbc9-6e3b-4d4c-8f32-c1ffd1bda188`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:34:58,653::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:34:58,653::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:34:58,654::task::1185::TaskManager.Task::(prepare) Task=`8395bbc9-6e3b-4d4c-8f32-c1ffd1bda188`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:34:58,654::task::595::TaskManager.Task::(_updateState) Task=`8395bbc9-6e3b-4d4c-8f32-c1ffd1bda188`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:34:58,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:34:58,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:34:58,654::task::990::TaskManager.Task::(_decref) Task=`8395bbc9-6e3b-4d4c-8f32-c1ffd1bda188`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:34:58,659::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 10:34:58,659::task::595::TaskManager.Task::(_updateState) Task=`f5f0356e-766b-4570-9994-5c84ea3adc0f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:34:58,659::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:34:58,660::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c1123037-14fa-4b40-9809-09a2a493fcce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:34:58,660::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:34:58,661::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:34:58,661::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c1123037-14fa-4b40-9809-09a2a493fcce`::Granted request
>Thread-34::DEBUG::2014-08-21 10:34:58,661::task::827::TaskManager.Task::(resourceAcquired) Task=`f5f0356e-766b-4570-9994-5c84ea3adc0f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:34:58,661::task::990::TaskManager.Task::(_decref) Task=`f5f0356e-766b-4570-9994-5c84ea3adc0f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:34:58,665::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:58,666::task::1185::TaskManager.Task::(prepare) Task=`f5f0356e-766b-4570-9994-5c84ea3adc0f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:34:58,666::task::595::TaskManager.Task::(_updateState) Task=`f5f0356e-766b-4570-9994-5c84ea3adc0f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:34:58,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:34:58,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:34:58,667::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:34:58,667::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:34:58,667::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:34:58,667::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:34:58,668::task::990::TaskManager.Task::(_decref) Task=`f5f0356e-766b-4570-9994-5c84ea3adc0f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:34:59,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:34:59,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.108875 s, 9.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:35:00,521::task::595::TaskManager.Task::(_updateState) Task=`c12d2472-7359-4a84-8071-9b4b5751dc42`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:35:00,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:35:00,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00437167', 'lastCheck': '7.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:35:00,523::task::1185::TaskManager.Task::(prepare) Task=`c12d2472-7359-4a84-8071-9b4b5751dc42`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00437167', 'lastCheck': '7.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:35:00,523::task::595::TaskManager.Task::(_updateState) Task=`c12d2472-7359-4a84-8071-9b4b5751dc42`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:35:00,523::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:35:00,523::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:35:00,524::task::990::TaskManager.Task::(_decref) Task=`c12d2472-7359-4a84-8071-9b4b5751dc42`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:35:01,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:02,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.585054 s, 1.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:35:02,903::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:35:03,105::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000997697 s, 499 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:04,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:05,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.212912 s, 4.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:07,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:07,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105991 s, 9.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:35:08,690::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-26::DEBUG::2014-08-21 10:35:08,692::task::595::TaskManager.Task::(_updateState) Task=`0c7b5911-28eb-4d7e-9896-fe9d4c7aa9e3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:35:08,692::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:35:08,693::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:08,693::task::1185::TaskManager.Task::(prepare) Task=`0c7b5911-28eb-4d7e-9896-fe9d4c7aa9e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:08,694::task::595::TaskManager.Task::(_updateState) Task=`0c7b5911-28eb-4d7e-9896-fe9d4c7aa9e3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:35:08,694::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:35:08,694::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:35:08,695::task::990::TaskManager.Task::(_decref) Task=`0c7b5911-28eb-4d7e-9896-fe9d4c7aa9e3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:35:08,700::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 10:35:08,701::task::595::TaskManager.Task::(_updateState) Task=`262eb3df-6828-4433-8d11-b76b6650bccf`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:35:08,701::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:35:08,702::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c1f5a32c-08de-44f2-87cf-bb77a407e8ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:35:08,702::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:35:08,703::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:35:08,703::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c1f5a32c-08de-44f2-87cf-bb77a407e8ff`::Granted request
>Thread-34::DEBUG::2014-08-21 10:35:08,704::task::827::TaskManager.Task::(resourceAcquired) Task=`262eb3df-6828-4433-8d11-b76b6650bccf`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:35:08,705::task::990::TaskManager.Task::(_decref) Task=`262eb3df-6828-4433-8d11-b76b6650bccf`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:35:08,712::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:08,712::task::1185::TaskManager.Task::(prepare) Task=`262eb3df-6828-4433-8d11-b76b6650bccf`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:08,713::task::595::TaskManager.Task::(_updateState) Task=`262eb3df-6828-4433-8d11-b76b6650bccf`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:35:08,713::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:35:08,713::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:35:08,714::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:35:08,714::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:35:08,715::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:35:08,715::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:35:08,715::task::990::TaskManager.Task::(_decref) Task=`262eb3df-6828-4433-8d11-b76b6650bccf`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:35:09,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:12,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.32065 s, 441 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:35:13,128::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:35:13,152::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00088386 s, 563 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:14,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:16,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.90285 s, 538 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:35:16,795::task::595::TaskManager.Task::(_updateState) Task=`eeb6c94a-ee28-46ac-ae42-28f89c5b8331`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:35:16,796::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:35:16,797::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088386', 'lastCheck': '3.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:35:16,797::task::1185::TaskManager.Task::(prepare) Task=`eeb6c94a-ee28-46ac-ae42-28f89c5b8331`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088386', 'lastCheck': '3.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:35:16,798::task::595::TaskManager.Task::(_updateState) Task=`eeb6c94a-ee28-46ac-ae42-28f89c5b8331`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:35:16,798::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:35:16,798::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:35:16,799::task::990::TaskManager.Task::(_decref) Task=`eeb6c94a-ee28-46ac-ae42-28f89c5b8331`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:35:18,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:35:18,753::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-26::DEBUG::2014-08-21 10:35:18,758::task::595::TaskManager.Task::(_updateState) Task=`dd3311a6-94ef-4dfc-911e-7441f6a2962e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:35:18,760::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:35:18,763::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:18,766::task::1185::TaskManager.Task::(prepare) Task=`dd3311a6-94ef-4dfc-911e-7441f6a2962e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:18,768::task::595::TaskManager.Task::(_updateState) Task=`dd3311a6-94ef-4dfc-911e-7441f6a2962e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:35:18,770::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:35:18,772::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:35:18,774::task::990::TaskManager.Task::(_decref) Task=`dd3311a6-94ef-4dfc-911e-7441f6a2962e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:35:18,785::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-34::DEBUG::2014-08-21 10:35:18,788::task::595::TaskManager.Task::(_updateState) Task=`e0c2e7f1-689c-4489-8917-440dfae97e57`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:35:18,790::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:35:18,792::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`913c3279-f58b-49d3-b93d-3b8bfde3835d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:35:18,793::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:35:18,794::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:35:18,795::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`913c3279-f58b-49d3-b93d-3b8bfde3835d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:35:18,798::task::827::TaskManager.Task::(resourceAcquired) Task=`e0c2e7f1-689c-4489-8917-440dfae97e57`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:35:18,799::task::990::TaskManager.Task::(_decref) Task=`e0c2e7f1-689c-4489-8917-440dfae97e57`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:35:18,821::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:18,823::task::1185::TaskManager.Task::(prepare) Task=`e0c2e7f1-689c-4489-8917-440dfae97e57`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:18,824::task::595::TaskManager.Task::(_updateState) Task=`e0c2e7f1-689c-4489-8917-440dfae97e57`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:35:18,825::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:35:18,826::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:35:18,827::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:35:18,829::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:35:18,829::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:35:18,830::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:35:18,832::task::990::TaskManager.Task::(_decref) Task=`e0c2e7f1-689c-4489-8917-440dfae97e57`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:35:18,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.114226 s, 9.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:21,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:22,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.761812 s, 1.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:35:23,185::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:35:23,238::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000988182 s, 504 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:24,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:25,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.258923 s, 4.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:27,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:35:30,695::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-26::DEBUG::2014-08-21 10:35:30,696::task::595::TaskManager.Task::(_updateState) Task=`bf4c1cd9-0aba-48e1-ab7f-8c747e1a11ca`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:35:30,697::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:35:30,697::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:30,698::task::1185::TaskManager.Task::(prepare) Task=`bf4c1cd9-0aba-48e1-ab7f-8c747e1a11ca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:30,698::task::595::TaskManager.Task::(_updateState) Task=`bf4c1cd9-0aba-48e1-ab7f-8c747e1a11ca`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:35:30,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:35:30,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:35:30,698::task::990::TaskManager.Task::(_decref) Task=`bf4c1cd9-0aba-48e1-ab7f-8c747e1a11ca`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:35:30,998::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-34::DEBUG::2014-08-21 10:35:30,999::task::595::TaskManager.Task::(_updateState) Task=`c3a41112-ec98-4448-92d8-635c0004e4ca`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:35:30,999::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:35:31,001::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fdaf75b7-118a-4bb0-b01b-1261d8b07d5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:35:31,001::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:35:31,002::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:35:31,029::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fdaf75b7-118a-4bb0-b01b-1261d8b07d5f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:35:31,036::task::827::TaskManager.Task::(resourceAcquired) Task=`c3a41112-ec98-4448-92d8-635c0004e4ca`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:35:31,037::task::990::TaskManager.Task::(_decref) Task=`c3a41112-ec98-4448-92d8-635c0004e4ca`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:35:31,050::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:31,051::task::1185::TaskManager.Task::(prepare) Task=`c3a41112-ec98-4448-92d8-635c0004e4ca`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:31,051::task::595::TaskManager.Task::(_updateState) Task=`c3a41112-ec98-4448-92d8-635c0004e4ca`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:35:31,052::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:35:31,072::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:35:31,074::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:35:31,074::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:35:31,074::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:35:31,075::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:35:31,075::task::990::TaskManager.Task::(_decref) Task=`c3a41112-ec98-4448-92d8-635c0004e4ca`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:35:31,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.506416 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:33,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:35:33,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:35:33,441::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0211 s, 23.6 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:35:33,843::task::595::TaskManager.Task::(_updateState) Task=`361e3d0e-51fc-4909-a17c-912fac2cd826`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:35:33,845::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:35:33,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0211', 'lastCheck': '0.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:35:33,847::task::1185::TaskManager.Task::(prepare) Task=`361e3d0e-51fc-4909-a17c-912fac2cd826`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0211', 'lastCheck': '0.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:35:33,848::task::595::TaskManager.Task::(_updateState) Task=`361e3d0e-51fc-4909-a17c-912fac2cd826`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:35:33,848::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:35:33,849::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:35:33,850::task::990::TaskManager.Task::(_decref) Task=`361e3d0e-51fc-4909-a17c-912fac2cd826`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:35:33,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.338296 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:36,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:36,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0669007 s, 15.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:38,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:38,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.122531 s, 8.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:40,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:40,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.249309 s, 4.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:35:41,112::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6feafe36]
>Thread-26::DEBUG::2014-08-21 10:35:41,115::task::595::TaskManager.Task::(_updateState) Task=`7956731e-2f50-4c79-91a1-1d3e684d56aa`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:35:41,115::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:35:41,116::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:41,116::task::1185::TaskManager.Task::(prepare) Task=`7956731e-2f50-4c79-91a1-1d3e684d56aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:41,117::task::595::TaskManager.Task::(_updateState) Task=`7956731e-2f50-4c79-91a1-1d3e684d56aa`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:35:41,117::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:35:41,117::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:35:41,118::task::990::TaskManager.Task::(_decref) Task=`7956731e-2f50-4c79-91a1-1d3e684d56aa`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:35:41,123::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6feafe36]
>Thread-34::DEBUG::2014-08-21 10:35:41,124::task::595::TaskManager.Task::(_updateState) Task=`b9213649-a551-4d3e-941d-8edd1cfded77`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:35:41,125::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:35:41,126::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`708176c5-f1a8-4f7c-9b96-cd53bdf3eb4d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:35:41,126::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:35:41,127::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:35:41,127::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`708176c5-f1a8-4f7c-9b96-cd53bdf3eb4d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:35:41,128::task::827::TaskManager.Task::(resourceAcquired) Task=`b9213649-a551-4d3e-941d-8edd1cfded77`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:35:41,128::task::990::TaskManager.Task::(_decref) Task=`b9213649-a551-4d3e-941d-8edd1cfded77`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:35:41,133::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:41,133::task::1185::TaskManager.Task::(prepare) Task=`b9213649-a551-4d3e-941d-8edd1cfded77`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:41,134::task::595::TaskManager.Task::(_updateState) Task=`b9213649-a551-4d3e-941d-8edd1cfded77`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:35:41,134::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:35:41,134::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:35:41,135::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:35:41,135::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:35:41,135::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:35:41,135::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:35:41,136::task::990::TaskManager.Task::(_decref) Task=`b9213649-a551-4d3e-941d-8edd1cfded77`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:35:42,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:35:43,899::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:35:44,598::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00373617 s, 133 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:45,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.13979 s, 479 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:47,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:47,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0736503 s, 13.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:35:49,359::task::595::TaskManager.Task::(_updateState) Task=`627231fd-0ceb-482f-90e2-3da1639cdab4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:35:49,359::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:35:49,360::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00373617', 'lastCheck': '4.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:35:49,360::task::1185::TaskManager.Task::(prepare) Task=`627231fd-0ceb-482f-90e2-3da1639cdab4`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00373617', 'lastCheck': '4.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:35:49,360::task::595::TaskManager.Task::(_updateState) Task=`627231fd-0ceb-482f-90e2-3da1639cdab4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:35:49,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:35:49,361::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:35:49,361::task::990::TaskManager.Task::(_decref) Task=`627231fd-0ceb-482f-90e2-3da1639cdab4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:35:49,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:49,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.142439 s, 7.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:35:51,160::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-26::DEBUG::2014-08-21 10:35:51,162::task::595::TaskManager.Task::(_updateState) Task=`4fbf4a12-a44f-4658-b38e-9aecc05d68ee`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:35:51,164::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:35:51,164::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:51,165::task::1185::TaskManager.Task::(prepare) Task=`4fbf4a12-a44f-4658-b38e-9aecc05d68ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:35:51,165::task::595::TaskManager.Task::(_updateState) Task=`4fbf4a12-a44f-4658-b38e-9aecc05d68ee`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:35:51,165::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:35:51,166::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:35:51,166::task::990::TaskManager.Task::(_decref) Task=`4fbf4a12-a44f-4658-b38e-9aecc05d68ee`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:35:51,174::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-34::DEBUG::2014-08-21 10:35:51,175::task::595::TaskManager.Task::(_updateState) Task=`7a566902-d4d8-4ce7-a7b0-e5ad64053c15`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:35:51,176::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:35:51,180::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c43c50bb-252e-4bf0-8f17-62c5c603b3c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:35:51,182::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:35:51,182::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:35:51,183::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c43c50bb-252e-4bf0-8f17-62c5c603b3c1`::Granted request
>Thread-34::DEBUG::2014-08-21 10:35:51,184::task::827::TaskManager.Task::(resourceAcquired) Task=`7a566902-d4d8-4ce7-a7b0-e5ad64053c15`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:35:51,184::task::990::TaskManager.Task::(_decref) Task=`7a566902-d4d8-4ce7-a7b0-e5ad64053c15`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:35:51,192::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:51,192::task::1185::TaskManager.Task::(prepare) Task=`7a566902-d4d8-4ce7-a7b0-e5ad64053c15`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:35:51,193::task::595::TaskManager.Task::(_updateState) Task=`7a566902-d4d8-4ce7-a7b0-e5ad64053c15`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:35:51,203::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:35:51,205::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:35:51,210::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:35:51,211::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:35:51,211::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:35:51,214::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:35:51,215::task::990::TaskManager.Task::(_decref) Task=`7a566902-d4d8-4ce7-a7b0-e5ad64053c15`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:35:51,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:51,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101489 s, 10.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:53,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:35:54,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0774925 s, 13.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:35:56,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:35:57,550::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:35:59,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000722034 s, 690 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:00,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.12195 s, 328 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:36:01,246::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-26::DEBUG::2014-08-21 10:36:01,259::task::595::TaskManager.Task::(_updateState) Task=`e6b19326-84ef-476f-a463-2608b40bd51c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:36:01,260::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:36:01,367::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:36:02,058::task::1185::TaskManager.Task::(prepare) Task=`e6b19326-84ef-476f-a463-2608b40bd51c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:36:02,106::task::595::TaskManager.Task::(_updateState) Task=`e6b19326-84ef-476f-a463-2608b40bd51c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:36:02,251::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:36:02,269::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:36:02,280::task::990::TaskManager.Task::(_decref) Task=`e6b19326-84ef-476f-a463-2608b40bd51c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:02,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:36:02,348::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 10:36:02,350::task::595::TaskManager.Task::(_updateState) Task=`e547d826-33c9-4729-be67-c2e1625dc7d1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:36:02,352::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:36:02,353::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`928cf732-3c70-4438-8d6c-cf144e69c1cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:36:02,354::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:36:02,354::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:36:02,355::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`928cf732-3c70-4438-8d6c-cf144e69c1cb`::Granted request
>Thread-34::DEBUG::2014-08-21 10:36:02,356::task::827::TaskManager.Task::(resourceAcquired) Task=`e547d826-33c9-4729-be67-c2e1625dc7d1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:36:02,356::task::990::TaskManager.Task::(_decref) Task=`e547d826-33c9-4729-be67-c2e1625dc7d1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:36:02,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:02,362::task::1185::TaskManager.Task::(prepare) Task=`e547d826-33c9-4729-be67-c2e1625dc7d1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:02,362::task::595::TaskManager.Task::(_updateState) Task=`e547d826-33c9-4729-be67-c2e1625dc7d1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:36:02,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:36:02,363::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:36:02,363::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:36:02,364::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:36:02,364::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:36:02,364::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:36:02,364::task::990::TaskManager.Task::(_decref) Task=`e547d826-33c9-4729-be67-c2e1625dc7d1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:02,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.259779 s, 3.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:04,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:04,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.117182 s, 8.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:06,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:36:08,456::task::595::TaskManager.Task::(_updateState) Task=`215868c2-f447-4b26-9b03-35656e4cd14e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:36:08,457::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:36:08,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722034', 'lastCheck': '8.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:36:08,459::task::1185::TaskManager.Task::(prepare) Task=`215868c2-f447-4b26-9b03-35656e4cd14e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722034', 'lastCheck': '8.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:36:08,459::task::595::TaskManager.Task::(_updateState) Task=`215868c2-f447-4b26-9b03-35656e4cd14e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:36:08,460::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:36:08,468::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:36:08,480::task::990::TaskManager.Task::(_decref) Task=`215868c2-f447-4b26-9b03-35656e4cd14e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:08,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.21072 s, 846 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:36:10,147::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:36:10,172::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00524796 s, 94.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:10,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:11,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.268253 s, 3.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:36:12,387::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-26::DEBUG::2014-08-21 10:36:12,388::task::595::TaskManager.Task::(_updateState) Task=`210e1976-b8e3-41fe-9e59-1e4c860d120f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:36:12,389::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:36:12,390::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:36:12,390::task::1185::TaskManager.Task::(prepare) Task=`210e1976-b8e3-41fe-9e59-1e4c860d120f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:36:12,390::task::595::TaskManager.Task::(_updateState) Task=`210e1976-b8e3-41fe-9e59-1e4c860d120f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:36:12,390::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:36:12,391::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:36:12,391::task::990::TaskManager.Task::(_decref) Task=`210e1976-b8e3-41fe-9e59-1e4c860d120f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:36:12,397::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 10:36:12,398::task::595::TaskManager.Task::(_updateState) Task=`29b40431-8663-48e5-91b9-628ce98bf88c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:36:12,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:36:12,399::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1e74720a-b75e-4bb3-bee6-f16fae64a5c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:36:12,399::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:36:12,400::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:36:12,400::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1e74720a-b75e-4bb3-bee6-f16fae64a5c6`::Granted request
>Thread-34::DEBUG::2014-08-21 10:36:12,401::task::827::TaskManager.Task::(resourceAcquired) Task=`29b40431-8663-48e5-91b9-628ce98bf88c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:36:12,401::task::990::TaskManager.Task::(_decref) Task=`29b40431-8663-48e5-91b9-628ce98bf88c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:36:12,407::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:12,408::task::1185::TaskManager.Task::(prepare) Task=`29b40431-8663-48e5-91b9-628ce98bf88c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:12,408::task::595::TaskManager.Task::(_updateState) Task=`29b40431-8663-48e5-91b9-628ce98bf88c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:36:12,408::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:36:12,409::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:36:12,410::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:36:12,410::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:36:12,410::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:36:12,411::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:36:12,411::task::990::TaskManager.Task::(_decref) Task=`29b40431-8663-48e5-91b9-628ce98bf88c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:13,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:14,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.718905 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:16,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:16,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.092727 s, 11.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:18,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:19,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107361 s, 9.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:36:20,204::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:36:20,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00458968 s, 109 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:21,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:21,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0637562 s, 16.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:36:22,439::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-26::DEBUG::2014-08-21 10:36:22,440::task::595::TaskManager.Task::(_updateState) Task=`f58d5b8e-c792-4104-baef-b4cea88ca0bc`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:36:22,440::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:36:22,441::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:36:22,441::task::1185::TaskManager.Task::(prepare) Task=`f58d5b8e-c792-4104-baef-b4cea88ca0bc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:36:22,442::task::595::TaskManager.Task::(_updateState) Task=`f58d5b8e-c792-4104-baef-b4cea88ca0bc`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:36:22,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:36:22,442::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:36:22,442::task::990::TaskManager.Task::(_decref) Task=`f58d5b8e-c792-4104-baef-b4cea88ca0bc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:36:22,462::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 10:36:22,463::task::595::TaskManager.Task::(_updateState) Task=`028c76ac-f30d-4bb1-bc2a-d625744874d4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:36:22,463::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:36:22,464::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`741a1b51-2d16-4a31-bfef-e0fbab277a30`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:36:22,464::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:36:22,465::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:36:22,465::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`741a1b51-2d16-4a31-bfef-e0fbab277a30`::Granted request
>Thread-34::DEBUG::2014-08-21 10:36:22,466::task::827::TaskManager.Task::(resourceAcquired) Task=`028c76ac-f30d-4bb1-bc2a-d625744874d4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:36:22,466::task::990::TaskManager.Task::(_decref) Task=`028c76ac-f30d-4bb1-bc2a-d625744874d4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:36:22,471::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:22,472::task::1185::TaskManager.Task::(prepare) Task=`028c76ac-f30d-4bb1-bc2a-d625744874d4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:22,472::task::595::TaskManager.Task::(_updateState) Task=`028c76ac-f30d-4bb1-bc2a-d625744874d4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:36:22,472::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:36:22,473::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:36:22,473::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:36:22,474::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:36:22,474::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:36:22,474::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:36:22,474::task::990::TaskManager.Task::(_decref) Task=`028c76ac-f30d-4bb1-bc2a-d625744874d4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:23,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:36:24,109::task::595::TaskManager.Task::(_updateState) Task=`e977993c-10c1-4df7-a41f-038ebf012683`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:36:25,647::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:36:25,648::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00458968', 'lastCheck': '5.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:36:25,648::task::1185::TaskManager.Task::(prepare) Task=`e977993c-10c1-4df7-a41f-038ebf012683`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00458968', 'lastCheck': '5.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:36:25,648::task::595::TaskManager.Task::(_updateState) Task=`e977993c-10c1-4df7-a41f-038ebf012683`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:36:25,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:36:25,662::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:36:25,744::task::990::TaskManager.Task::(_decref) Task=`e977993c-10c1-4df7-a41f-038ebf012683`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:25,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.370936 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:27,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:27,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0805832 s, 12.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:29,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:30,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0688892 s, 14.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:36:30,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:36:30,300::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000546612 s, 911 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:36:32,682::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-13::DEBUG::2014-08-21 10:36:32,790::task::595::TaskManager.Task::(_updateState) Task=`461f27db-59b8-4e30-a19f-20bce503b51d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:36:32,791::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 10:36:32,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::INFO::2014-08-21 10:36:33,078::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:36:33,079::task::1185::TaskManager.Task::(prepare) Task=`461f27db-59b8-4e30-a19f-20bce503b51d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:36:33,079::task::595::TaskManager.Task::(_updateState) Task=`461f27db-59b8-4e30-a19f-20bce503b51d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:36:33,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:36:33,080::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:36:33,080::task::990::TaskManager.Task::(_decref) Task=`461f27db-59b8-4e30-a19f-20bce503b51d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:36:33,485::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-34::DEBUG::2014-08-21 10:36:33,486::task::595::TaskManager.Task::(_updateState) Task=`c260aa8c-f34d-4d03-91ec-850ea95b5a23`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:36:33,486::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:36:33,487::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c6801b2b-759e-40ce-94b4-675e66df7d3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:36:33,487::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:36:33,488::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:36:33,488::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c6801b2b-759e-40ce-94b4-675e66df7d3a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:36:33,489::task::827::TaskManager.Task::(resourceAcquired) Task=`c260aa8c-f34d-4d03-91ec-850ea95b5a23`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:36:33,489::task::990::TaskManager.Task::(_decref) Task=`c260aa8c-f34d-4d03-91ec-850ea95b5a23`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:36:33,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:33,548::task::1185::TaskManager.Task::(prepare) Task=`c260aa8c-f34d-4d03-91ec-850ea95b5a23`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:33,551::task::595::TaskManager.Task::(_updateState) Task=`c260aa8c-f34d-4d03-91ec-850ea95b5a23`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:36:33,552::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:36:33,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:36:33,557::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:36:33,558::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:36:33,559::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:36:33,560::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:36:33,561::task::990::TaskManager.Task::(_decref) Task=`c260aa8c-f34d-4d03-91ec-850ea95b5a23`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:33,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.561275 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:35,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:35,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0830584 s, 12.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:37,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:37,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472975 s, 21.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:39,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:40,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0765309 s, 13.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:36:40,339::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:36:40,356::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000687276 s, 725 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:42,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:36:42,220::task::595::TaskManager.Task::(_updateState) Task=`01729f1d-2d7d-4a5b-9223-86e5b5e2ee9f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:36:42,221::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:36:42,222::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687276', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:36:42,222::task::1185::TaskManager.Task::(prepare) Task=`01729f1d-2d7d-4a5b-9223-86e5b5e2ee9f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687276', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:36:42,222::task::595::TaskManager.Task::(_updateState) Task=`01729f1d-2d7d-4a5b-9223-86e5b5e2ee9f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:36:42,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:36:42,223::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:36:42,223::task::990::TaskManager.Task::(_decref) Task=`01729f1d-2d7d-4a5b-9223-86e5b5e2ee9f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:42,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0871236 s, 11.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:36:43,583::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-13::DEBUG::2014-08-21 10:36:43,584::task::595::TaskManager.Task::(_updateState) Task=`315b1706-2938-4f26-be2d-efc1dd150e66`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:36:43,584::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:36:43,585::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:36:43,585::task::1185::TaskManager.Task::(prepare) Task=`315b1706-2938-4f26-be2d-efc1dd150e66`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:36:43,585::task::595::TaskManager.Task::(_updateState) Task=`315b1706-2938-4f26-be2d-efc1dd150e66`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:36:43,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:36:43,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:36:43,585::task::990::TaskManager.Task::(_decref) Task=`315b1706-2938-4f26-be2d-efc1dd150e66`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:36:43,589::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-34::DEBUG::2014-08-21 10:36:43,590::task::595::TaskManager.Task::(_updateState) Task=`65cd621c-d28b-4bbc-9335-ea6606c2bf44`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:36:43,590::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:36:43,590::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e1bf9065-6162-4951-a83c-1ed5467c6637`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:36:43,591::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:36:43,591::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:36:43,591::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e1bf9065-6162-4951-a83c-1ed5467c6637`::Granted request
>Thread-34::DEBUG::2014-08-21 10:36:43,592::task::827::TaskManager.Task::(resourceAcquired) Task=`65cd621c-d28b-4bbc-9335-ea6606c2bf44`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:36:43,592::task::990::TaskManager.Task::(_decref) Task=`65cd621c-d28b-4bbc-9335-ea6606c2bf44`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:36:43,595::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:43,596::task::1185::TaskManager.Task::(prepare) Task=`65cd621c-d28b-4bbc-9335-ea6606c2bf44`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:43,596::task::595::TaskManager.Task::(_updateState) Task=`65cd621c-d28b-4bbc-9335-ea6606c2bf44`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:36:43,596::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:36:43,596::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:36:43,597::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:36:43,597::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:36:43,597::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:36:43,597::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:36:43,597::task::990::TaskManager.Task::(_decref) Task=`65cd621c-d28b-4bbc-9335-ea6606c2bf44`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:44,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:44,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.066289 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:46,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:47,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.330499 s, 3.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:50,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:50,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0816487 s, 12.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:36:50,378::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:36:50,395::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00123778 s, 402 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:52,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:36:54,039::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-13::DEBUG::2014-08-21 10:36:54,055::task::595::TaskManager.Task::(_updateState) Task=`4f834c83-ae4c-4422-afbd-685eda3d3248`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:36:54,056::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:36:54,056::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:36:54,057::task::1185::TaskManager.Task::(prepare) Task=`4f834c83-ae4c-4422-afbd-685eda3d3248`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:36:54,057::task::595::TaskManager.Task::(_updateState) Task=`4f834c83-ae4c-4422-afbd-685eda3d3248`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:36:54,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:36:54,058::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:36:54,058::task::990::TaskManager.Task::(_decref) Task=`4f834c83-ae4c-4422-afbd-685eda3d3248`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:54,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.36532 s, 2.8 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:36:54,216::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 10:36:54,218::task::595::TaskManager.Task::(_updateState) Task=`2fc7d077-0b59-417f-8307-852c3b30dd77`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:36:54,245::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:36:54,265::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8ce34a39-1a67-4052-98a5-3efd4be8cfa9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:36:54,265::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:36:54,287::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:36:54,288::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8ce34a39-1a67-4052-98a5-3efd4be8cfa9`::Granted request
>Thread-34::DEBUG::2014-08-21 10:36:54,289::task::827::TaskManager.Task::(resourceAcquired) Task=`2fc7d077-0b59-417f-8307-852c3b30dd77`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:36:54,300::task::990::TaskManager.Task::(_decref) Task=`2fc7d077-0b59-417f-8307-852c3b30dd77`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:36:54,343::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:54,344::task::1185::TaskManager.Task::(prepare) Task=`2fc7d077-0b59-417f-8307-852c3b30dd77`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:36:54,344::task::595::TaskManager.Task::(_updateState) Task=`2fc7d077-0b59-417f-8307-852c3b30dd77`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:36:54,344::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:36:54,345::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:36:54,345::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:36:54,346::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:36:54,346::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:36:54,346::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:36:54,360::task::990::TaskManager.Task::(_decref) Task=`2fc7d077-0b59-417f-8307-852c3b30dd77`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:36:56,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:36:56,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0741753 s, 13.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:36:58,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:36:59,898::task::595::TaskManager.Task::(_updateState) Task=`d320a120-b8af-4751-99c7-c5fb42d44c35`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:36:59,910::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:36:59,946::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123778', 'lastCheck': '9.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:36:59,954::task::1185::TaskManager.Task::(prepare) Task=`d320a120-b8af-4751-99c7-c5fb42d44c35`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123778', 'lastCheck': '9.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:36:59,954::task::595::TaskManager.Task::(_updateState) Task=`d320a120-b8af-4751-99c7-c5fb42d44c35`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:36:59,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:36:59,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:36:59,959::task::990::TaskManager.Task::(_decref) Task=`d320a120-b8af-4751-99c7-c5fb42d44c35`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:37:00,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.382674 s, 2.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:37:00,515::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:37:00,531::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00431659 s, 115 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:02,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:37:04,391::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-13::DEBUG::2014-08-21 10:37:04,393::task::595::TaskManager.Task::(_updateState) Task=`3f539e82-7ce5-4ced-bf5e-3c0fa2c20ce9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:37:04,393::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:37:04,394::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:37:04,394::task::1185::TaskManager.Task::(prepare) Task=`3f539e82-7ce5-4ced-bf5e-3c0fa2c20ce9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:37:04,394::task::595::TaskManager.Task::(_updateState) Task=`3f539e82-7ce5-4ced-bf5e-3c0fa2c20ce9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:37:04,394::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:37:04,394::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:37:04,395::task::990::TaskManager.Task::(_decref) Task=`3f539e82-7ce5-4ced-bf5e-3c0fa2c20ce9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:37:04,490::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-34::DEBUG::2014-08-21 10:37:04,546::task::595::TaskManager.Task::(_updateState) Task=`0f5553fc-6163-4344-8f98-8c62c4a422cf`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:37:04,605::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:37:04,783::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bc036b0c-23ba-41d0-a801-ac627e416d32`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:37:04,784::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:37:04,823::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:37:04,824::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bc036b0c-23ba-41d0-a801-ac627e416d32`::Granted request
>Thread-34::DEBUG::2014-08-21 10:37:04,838::task::827::TaskManager.Task::(resourceAcquired) Task=`0f5553fc-6163-4344-8f98-8c62c4a422cf`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:37:04,839::task::990::TaskManager.Task::(_decref) Task=`0f5553fc-6163-4344-8f98-8c62c4a422cf`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:37:07,722::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:07,724::task::1185::TaskManager.Task::(prepare) Task=`0f5553fc-6163-4344-8f98-8c62c4a422cf`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:07,724::task::595::TaskManager.Task::(_updateState) Task=`0f5553fc-6163-4344-8f98-8c62c4a422cf`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:37:07,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:37:07,726::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:37:07,805::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:37:08,852::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:37:08,859::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:37:08,860::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:37:08,943::task::990::TaskManager.Task::(_decref) Task=`0f5553fc-6163-4344-8f98-8c62c4a422cf`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:37:09,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.55732 s, 184 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:37:10,549::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:37:10,564::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00179628 s, 277 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:11,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:11,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.752485 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:14,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:14,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104681 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:16,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:16,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0581585 s, 17.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:37:25,382::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-26::DEBUG::2014-08-21 10:37:25,385::task::595::TaskManager.Task::(_updateState) Task=`cc810cf4-7b90-41c0-8b2d-d997def287a7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:37:25,386::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:37:25,396::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:37:25,408::task::1185::TaskManager.Task::(prepare) Task=`cc810cf4-7b90-41c0-8b2d-d997def287a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:37:25,429::task::595::TaskManager.Task::(_updateState) Task=`cc810cf4-7b90-41c0-8b2d-d997def287a7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:37:25,439::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:37:25,447::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:37:25,462::task::595::TaskManager.Task::(_updateState) Task=`614351e3-8284-443c-9413-6a7fbffa6cfc`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 10:37:25,466::task::990::TaskManager.Task::(_decref) Task=`cc810cf4-7b90-41c0-8b2d-d997def287a7`::ref 0 aborting False
>Thread-13::INFO::2014-08-21 10:37:25,508::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Dummy-33::DEBUG::2014-08-21 10:37:25,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::INFO::2014-08-21 10:37:25,525::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00179628', 'lastCheck': '14.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:37:25,588::task::1185::TaskManager.Task::(prepare) Task=`614351e3-8284-443c-9413-6a7fbffa6cfc`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00179628', 'lastCheck': '14.9', 'valid': True}}
>Thread-34::DEBUG::2014-08-21 10:37:25,603::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-34::DEBUG::2014-08-21 10:37:25,630::task::595::TaskManager.Task::(_updateState) Task=`ec16dc6e-57ee-4af0-b2db-b8d2c46539e4`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 10:37:25,632::task::595::TaskManager.Task::(_updateState) Task=`614351e3-8284-443c-9413-6a7fbffa6cfc`::moving from state preparing -> state finished
>Thread-34::INFO::2014-08-21 10:37:25,644::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::DEBUG::2014-08-21 10:37:25,673::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-34::DEBUG::2014-08-21 10:37:25,701::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2b8b4d05-6240-4d46-9025-08d825ef3635`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:37:25,712::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-13::DEBUG::2014-08-21 10:37:25,714::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:37:25,727::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:37:25,741::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2b8b4d05-6240-4d46-9025-08d825ef3635`::Granted request
>Thread-13::DEBUG::2014-08-21 10:37:25,745::task::990::TaskManager.Task::(_decref) Task=`614351e3-8284-443c-9413-6a7fbffa6cfc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:37:25,778::task::827::TaskManager.Task::(resourceAcquired) Task=`ec16dc6e-57ee-4af0-b2db-b8d2c46539e4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:37:25,793::task::990::TaskManager.Task::(_decref) Task=`ec16dc6e-57ee-4af0-b2db-b8d2c46539e4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:37:25,941::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:25,957::task::1185::TaskManager.Task::(prepare) Task=`ec16dc6e-57ee-4af0-b2db-b8d2c46539e4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:25,968::task::595::TaskManager.Task::(_updateState) Task=`ec16dc6e-57ee-4af0-b2db-b8d2c46539e4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:37:25,976::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-15::DEBUG::2014-08-21 10:37:25,983::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:37:25,984::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:37:26,027::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:37:26,047::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:37:26,054::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:37:26,057::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:37:26,060::task::990::TaskManager.Task::(_decref) Task=`ec16dc6e-57ee-4af0-b2db-b8d2c46539e4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:37:26,077::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000914898 s, 544 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:26,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.652088 s, 1.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:28,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:28,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.168301 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:30,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:30,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.142892 s, 7.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:32,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:33,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.865114 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:35,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:37:36,157::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-13::DEBUG::2014-08-21 10:37:36,159::task::595::TaskManager.Task::(_updateState) Task=`4f1f1105-9644-48db-8277-ff63bd290251`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:37:36,363::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:37:36,364::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:37:36,365::task::1185::TaskManager.Task::(prepare) Task=`4f1f1105-9644-48db-8277-ff63bd290251`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:37:36,365::task::595::TaskManager.Task::(_updateState) Task=`4f1f1105-9644-48db-8277-ff63bd290251`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:37:36,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:37:36,366::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:37:36,367::task::990::TaskManager.Task::(_decref) Task=`4f1f1105-9644-48db-8277-ff63bd290251`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:37:36,412::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-34::DEBUG::2014-08-21 10:37:36,424::task::595::TaskManager.Task::(_updateState) Task=`d9a84cea-1ba4-4e2a-97b7-fc14e6f365d9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:37:36,438::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:37:36,507::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`272e79a9-3967-400a-9fb9-765058279a49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:37:36,551::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:37:36,566::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:37:36,570::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`272e79a9-3967-400a-9fb9-765058279a49`::Granted request
>Thread-34::DEBUG::2014-08-21 10:37:36,609::task::827::TaskManager.Task::(resourceAcquired) Task=`d9a84cea-1ba4-4e2a-97b7-fc14e6f365d9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:37:36,611::task::990::TaskManager.Task::(_decref) Task=`d9a84cea-1ba4-4e2a-97b7-fc14e6f365d9`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:37:36,858::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:37:36,941::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:36,942::task::1185::TaskManager.Task::(prepare) Task=`d9a84cea-1ba4-4e2a-97b7-fc14e6f365d9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:36,943::task::595::TaskManager.Task::(_updateState) Task=`d9a84cea-1ba4-4e2a-97b7-fc14e6f365d9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:37:36,943::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:37:36,944::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:37:36,945::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:37:36,946::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:37:36,946::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:37:36,946::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:37:36,947::task::990::TaskManager.Task::(_decref) Task=`d9a84cea-1ba4-4e2a-97b7-fc14e6f365d9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:37:37,240::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0074425 s, 66.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:37,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.57314 s, 651 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:39,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:40,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.445276 s, 2.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:37:41,395::task::595::TaskManager.Task::(_updateState) Task=`2b268534-4619-4515-a8c7-36657bdaa10b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:37:41,396::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:37:41,396::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074425', 'lastCheck': '3.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:37:41,397::task::1185::TaskManager.Task::(prepare) Task=`2b268534-4619-4515-a8c7-36657bdaa10b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074425', 'lastCheck': '3.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:37:41,398::task::595::TaskManager.Task::(_updateState) Task=`2b268534-4619-4515-a8c7-36657bdaa10b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:37:41,398::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:37:41,398::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:37:41,399::task::990::TaskManager.Task::(_decref) Task=`2b268534-4619-4515-a8c7-36657bdaa10b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:37:42,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:37:47,827::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-26::DEBUG::2014-08-21 10:37:47,837::task::595::TaskManager.Task::(_updateState) Task=`e34f8db6-1f34-414f-827b-d9a1069b274b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:37:47,873::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:37:47,875::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:37:47,877::task::1185::TaskManager.Task::(prepare) Task=`e34f8db6-1f34-414f-827b-d9a1069b274b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:37:47,877::task::595::TaskManager.Task::(_updateState) Task=`e34f8db6-1f34-414f-827b-d9a1069b274b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:37:47,878::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:37:47,879::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:37:47,881::task::990::TaskManager.Task::(_decref) Task=`e34f8db6-1f34-414f-827b-d9a1069b274b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:37:47,894::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-34::DEBUG::2014-08-21 10:37:47,899::task::595::TaskManager.Task::(_updateState) Task=`a1e8f6a5-deb9-4107-88c7-17343d77810e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:37:47,901::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:37:47,907::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2471bdcc-e21d-4adf-b93c-8f6c9f5e3161`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:37:47,914::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:37:47,917::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:37:47,920::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2471bdcc-e21d-4adf-b93c-8f6c9f5e3161`::Granted request
>Thread-34::DEBUG::2014-08-21 10:37:47,928::task::827::TaskManager.Task::(resourceAcquired) Task=`a1e8f6a5-deb9-4107-88c7-17343d77810e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:37:47,930::task::990::TaskManager.Task::(_decref) Task=`a1e8f6a5-deb9-4107-88c7-17343d77810e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:37:47,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:47,943::task::1185::TaskManager.Task::(prepare) Task=`a1e8f6a5-deb9-4107-88c7-17343d77810e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:47,943::task::595::TaskManager.Task::(_updateState) Task=`a1e8f6a5-deb9-4107-88c7-17343d77810e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:37:47,944::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:37:47,945::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:37:47,946::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:37:47,947::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:37:47,947::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:37:47,948::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:37:47,949::task::990::TaskManager.Task::(_decref) Task=`a1e8f6a5-deb9-4107-88c7-17343d77810e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:37:48,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.4276 s, 189 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:37:48,213::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:37:48,232::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000472149 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:50,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:51,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.41467 s, 724 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:53,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:53,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526679 s, 19.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:37:55,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:37:55,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0592007 s, 17.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:37:57,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Dummy-33::DEBUG::2014-08-21 10:37:58,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:37:58,275::task::595::TaskManager.Task::(_updateState) Task=`46203fdc-a8fc-4780-8bb5-79de13b8f375`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:37:58,277::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:37:58,277::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:37:58,278::task::1185::TaskManager.Task::(prepare) Task=`46203fdc-a8fc-4780-8bb5-79de13b8f375`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:37:58,286::task::595::TaskManager.Task::(_updateState) Task=`46203fdc-a8fc-4780-8bb5-79de13b8f375`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:37:58,287::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:37:58,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:37:58,288::task::990::TaskManager.Task::(_decref) Task=`46203fdc-a8fc-4780-8bb5-79de13b8f375`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:37:58,443::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-34::DEBUG::2014-08-21 10:37:58,444::task::595::TaskManager.Task::(_updateState) Task=`267d1ce5-d40a-4add-a5da-e9d321a711e8`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:37:58,445::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:37:58,453::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d310ad85-0624-48ec-8650-ec7a5da1dd05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:37:58,454::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:37:58,454::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:37:58,460::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d310ad85-0624-48ec-8650-ec7a5da1dd05`::Granted request
>Thread-34::DEBUG::2014-08-21 10:37:58,461::task::827::TaskManager.Task::(resourceAcquired) Task=`267d1ce5-d40a-4add-a5da-e9d321a711e8`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:37:58,461::task::990::TaskManager.Task::(_decref) Task=`267d1ce5-d40a-4add-a5da-e9d321a711e8`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:37:58,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:58,501::task::1185::TaskManager.Task::(prepare) Task=`267d1ce5-d40a-4add-a5da-e9d321a711e8`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:37:58,501::task::595::TaskManager.Task::(_updateState) Task=`267d1ce5-d40a-4add-a5da-e9d321a711e8`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:37:58,502::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:37:58,502::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:37:58,516::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:37:58,517::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:37:58,517::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:37:58,517::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:37:58,518::task::990::TaskManager.Task::(_decref) Task=`267d1ce5-d40a-4add-a5da-e9d321a711e8`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:37:59,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.09132 s, 938 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:37:59,707::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:37:59,787::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00902794 s, 55.2 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:38:00,498::task::595::TaskManager.Task::(_updateState) Task=`29af334f-420e-4dd3-b1b0-a8696d0853a3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:38:00,498::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:38:00,499::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00902794', 'lastCheck': '0.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:38:00,499::task::1185::TaskManager.Task::(prepare) Task=`29af334f-420e-4dd3-b1b0-a8696d0853a3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00902794', 'lastCheck': '0.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:38:00,499::task::595::TaskManager.Task::(_updateState) Task=`29af334f-420e-4dd3-b1b0-a8696d0853a3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:38:00,499::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:38:00,500::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:38:00,500::task::990::TaskManager.Task::(_decref) Task=`29af334f-420e-4dd3-b1b0-a8696d0853a3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:38:01,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:01,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0601889 s, 17.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:03,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:03,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0590253 s, 17.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:05,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:38:09,438::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-26::DEBUG::2014-08-21 10:38:09,446::task::595::TaskManager.Task::(_updateState) Task=`a4eca555-57b0-48f6-a7fd-918c4bd32360`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:38:09,447::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:38:09,450::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:09,451::task::1185::TaskManager.Task::(prepare) Task=`a4eca555-57b0-48f6-a7fd-918c4bd32360`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:09,452::task::595::TaskManager.Task::(_updateState) Task=`a4eca555-57b0-48f6-a7fd-918c4bd32360`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:38:09,452::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:38:09,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:38:09,458::task::990::TaskManager.Task::(_decref) Task=`a4eca555-57b0-48f6-a7fd-918c4bd32360`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:38:09,646::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-34::DEBUG::2014-08-21 10:38:09,648::task::595::TaskManager.Task::(_updateState) Task=`aa065229-4ab2-4977-8616-96c0179c6151`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:38:09,649::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:38:09,655::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`25ab6420-c849-4561-9c15-569622a9be9e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:38:09,659::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:38:09,662::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:38:09,665::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`25ab6420-c849-4561-9c15-569622a9be9e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:38:09,674::task::827::TaskManager.Task::(resourceAcquired) Task=`aa065229-4ab2-4977-8616-96c0179c6151`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:38:09,677::task::990::TaskManager.Task::(_decref) Task=`aa065229-4ab2-4977-8616-96c0179c6151`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:38:10,952::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:10,953::task::1185::TaskManager.Task::(prepare) Task=`aa065229-4ab2-4977-8616-96c0179c6151`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:10,953::task::595::TaskManager.Task::(_updateState) Task=`aa065229-4ab2-4977-8616-96c0179c6151`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:38:10,953::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:38:10,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:38:10,967::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:38:10,977::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:38:10,978::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:38:10,978::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:38:10,979::task::990::TaskManager.Task::(_decref) Task=`aa065229-4ab2-4977-8616-96c0179c6151`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:38:11,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.55023 s, 288 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:38:11,073::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:38:11,227::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0017214 s, 289 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:13,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:15,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.85058 s, 553 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:38:15,937::task::595::TaskManager.Task::(_updateState) Task=`5e336466-54e3-4102-b6a0-c87fd2d7c23d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:38:15,938::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:38:15,939::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0017214', 'lastCheck': '4.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:38:15,939::task::1185::TaskManager.Task::(prepare) Task=`5e336466-54e3-4102-b6a0-c87fd2d7c23d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0017214', 'lastCheck': '4.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:38:15,939::task::595::TaskManager.Task::(_updateState) Task=`5e336466-54e3-4102-b6a0-c87fd2d7c23d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:38:15,940::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:38:15,940::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:38:15,940::task::990::TaskManager.Task::(_decref) Task=`5e336466-54e3-4102-b6a0-c87fd2d7c23d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:38:17,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:17,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494892 s, 20.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:19,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:20,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.05545 s, 970 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:38:21,154::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-26::DEBUG::2014-08-21 10:38:21,155::task::595::TaskManager.Task::(_updateState) Task=`57958b5e-0cd1-41c2-8cf1-61391723e8fa`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:38:21,156::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:38:21,157::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:21,157::task::1185::TaskManager.Task::(prepare) Task=`57958b5e-0cd1-41c2-8cf1-61391723e8fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:21,157::task::595::TaskManager.Task::(_updateState) Task=`57958b5e-0cd1-41c2-8cf1-61391723e8fa`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:38:21,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:38:21,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:38:21,158::task::990::TaskManager.Task::(_decref) Task=`57958b5e-0cd1-41c2-8cf1-61391723e8fa`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:38:21,165::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 10:38:21,166::task::595::TaskManager.Task::(_updateState) Task=`efe2b2f2-1e67-4a5a-a5d0-858ab4667066`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:38:21,166::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:38:21,167::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`00b1b407-485f-4c95-9e72-1dd7c21d920e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:38:21,167::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:38:21,168::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:38:21,168::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`00b1b407-485f-4c95-9e72-1dd7c21d920e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:38:21,169::task::827::TaskManager.Task::(resourceAcquired) Task=`efe2b2f2-1e67-4a5a-a5d0-858ab4667066`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:38:21,169::task::990::TaskManager.Task::(_decref) Task=`efe2b2f2-1e67-4a5a-a5d0-858ab4667066`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:38:21,175::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:21,176::task::1185::TaskManager.Task::(prepare) Task=`efe2b2f2-1e67-4a5a-a5d0-858ab4667066`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:21,176::task::595::TaskManager.Task::(_updateState) Task=`efe2b2f2-1e67-4a5a-a5d0-858ab4667066`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:38:21,177::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:38:21,177::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:38:21,177::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:38:21,178::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:38:21,178::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:38:21,178::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:38:21,178::task::990::TaskManager.Task::(_decref) Task=`efe2b2f2-1e67-4a5a-a5d0-858ab4667066`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:38:21,256::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:38:21,262::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:38:21,264::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:38:21,273::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:38:21,276::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:38:21,276::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:38:21,276::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 10:38:21,289::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:38:21,307::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00052518 s, 948 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:22,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:22,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0727086 s, 14.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:24,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:24,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112338 s, 9.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:27,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:27,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.250892 s, 4.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:29,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:29,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.154597 s, 6.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:38:31,204::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-26::DEBUG::2014-08-21 10:38:31,206::task::595::TaskManager.Task::(_updateState) Task=`49257cae-3de2-4955-8363-d5dade444b11`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:38:31,207::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:38:31,208::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:31,230::task::1185::TaskManager.Task::(prepare) Task=`49257cae-3de2-4955-8363-d5dade444b11`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:31,230::task::595::TaskManager.Task::(_updateState) Task=`49257cae-3de2-4955-8363-d5dade444b11`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:38:31,231::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:38:31,231::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:38:31,231::task::990::TaskManager.Task::(_decref) Task=`49257cae-3de2-4955-8363-d5dade444b11`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:38:31,620::task::595::TaskManager.Task::(_updateState) Task=`661bbe94-371b-4eac-80e2-e308ea55580f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:38:31,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:38:31,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052518', 'lastCheck': '10.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:38:31,621::task::1185::TaskManager.Task::(prepare) Task=`661bbe94-371b-4eac-80e2-e308ea55580f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052518', 'lastCheck': '10.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:38:31,622::task::595::TaskManager.Task::(_updateState) Task=`661bbe94-371b-4eac-80e2-e308ea55580f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:38:31,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:38:31,622::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:38:31,623::task::990::TaskManager.Task::(_decref) Task=`661bbe94-371b-4eac-80e2-e308ea55580f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:38:31,698::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-34::DEBUG::2014-08-21 10:38:31,715::task::595::TaskManager.Task::(_updateState) Task=`c2517ca3-3af5-47a7-b815-c51963162baf`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:38:31,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:38:31,723::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:38:31,724::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`943704f6-374f-49e3-8384-617b633ea15c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:38:31,738::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:38:31,740::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:38:31,743::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`943704f6-374f-49e3-8384-617b633ea15c`::Granted request
>Thread-34::DEBUG::2014-08-21 10:38:31,761::task::827::TaskManager.Task::(resourceAcquired) Task=`c2517ca3-3af5-47a7-b815-c51963162baf`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:38:31,778::task::990::TaskManager.Task::(_decref) Task=`c2517ca3-3af5-47a7-b815-c51963162baf`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:38:31,792::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00858098 s, 58.0 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:38:31,802::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:31,802::task::1185::TaskManager.Task::(prepare) Task=`c2517ca3-3af5-47a7-b815-c51963162baf`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:31,802::task::595::TaskManager.Task::(_updateState) Task=`c2517ca3-3af5-47a7-b815-c51963162baf`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:38:31,803::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:38:31,803::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:38:31,803::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:38:31,804::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:38:31,804::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:38:31,804::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:38:31,804::task::990::TaskManager.Task::(_decref) Task=`c2517ca3-3af5-47a7-b815-c51963162baf`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:38:31,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:32,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.751373 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:34,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:34,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0587139 s, 17.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:36,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:37,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.665197 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:39,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:39,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0807315 s, 12.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:38:41,842::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Dummy-33::DEBUG::2014-08-21 10:38:42,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:38:44,661::task::595::TaskManager.Task::(_updateState) Task=`88994a75-5175-4bb2-b847-89de87811e80`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:38:44,683::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:38:44,694::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:44,715::task::1185::TaskManager.Task::(prepare) Task=`88994a75-5175-4bb2-b847-89de87811e80`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:44,724::task::595::TaskManager.Task::(_updateState) Task=`88994a75-5175-4bb2-b847-89de87811e80`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:38:44,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-15::DEBUG::2014-08-21 10:38:44,787::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:38:44,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:38:44,818::task::990::TaskManager.Task::(_decref) Task=`88994a75-5175-4bb2-b847-89de87811e80`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:38:44,826::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000447633 s, 1.1 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:38:44,833::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-34::DEBUG::2014-08-21 10:38:44,836::task::595::TaskManager.Task::(_updateState) Task=`85c8cfd1-b54d-410a-800b-d77c3cbcf43e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:38:44,839::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:38:44,843::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ff1848f-52f3-436a-b198-413b6aba3458`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:38:44,844::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:38:44,846::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:38:44,847::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ff1848f-52f3-436a-b198-413b6aba3458`::Granted request
>Thread-34::DEBUG::2014-08-21 10:38:44,852::task::827::TaskManager.Task::(resourceAcquired) Task=`85c8cfd1-b54d-410a-800b-d77c3cbcf43e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:38:44,855::task::990::TaskManager.Task::(_decref) Task=`85c8cfd1-b54d-410a-800b-d77c3cbcf43e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:38:44,880::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:44,881::task::1185::TaskManager.Task::(prepare) Task=`85c8cfd1-b54d-410a-800b-d77c3cbcf43e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:44,883::task::595::TaskManager.Task::(_updateState) Task=`85c8cfd1-b54d-410a-800b-d77c3cbcf43e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:38:44,884::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:38:44,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:38:44,886::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:38:44,887::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:38:44,888::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:38:44,889::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:38:44,890::task::990::TaskManager.Task::(_decref) Task=`85c8cfd1-b54d-410a-800b-d77c3cbcf43e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:38:44,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.67943 s, 610 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:47,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:47,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100795 s, 10.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:38:47,694::task::595::TaskManager.Task::(_updateState) Task=`15f99c50-5c40-4f04-8b7c-00411767071f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:38:47,695::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:38:47,695::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447633', 'lastCheck': '2.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:38:47,696::task::1185::TaskManager.Task::(prepare) Task=`15f99c50-5c40-4f04-8b7c-00411767071f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447633', 'lastCheck': '2.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:38:47,696::task::595::TaskManager.Task::(_updateState) Task=`15f99c50-5c40-4f04-8b7c-00411767071f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:38:47,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:38:47,696::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:38:47,696::task::990::TaskManager.Task::(_decref) Task=`15f99c50-5c40-4f04-8b7c-00411767071f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:38:49,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:50,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101437 s, 10.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:52,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:38:52,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0730598 s, 14.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:54,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:38:56,392::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-26::DEBUG::2014-08-21 10:38:56,394::task::595::TaskManager.Task::(_updateState) Task=`2f5bdcb8-8c81-46b5-8c2f-8b9e3e8ea928`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:38:56,411::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:38:56,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:56,460::task::1185::TaskManager.Task::(prepare) Task=`2f5bdcb8-8c81-46b5-8c2f-8b9e3e8ea928`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:38:56,465::task::595::TaskManager.Task::(_updateState) Task=`2f5bdcb8-8c81-46b5-8c2f-8b9e3e8ea928`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:38:56,471::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:38:56,472::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:38:56,473::task::990::TaskManager.Task::(_decref) Task=`2f5bdcb8-8c81-46b5-8c2f-8b9e3e8ea928`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:38:56,833::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-34::DEBUG::2014-08-21 10:38:56,852::task::595::TaskManager.Task::(_updateState) Task=`6b1f584a-715f-4aee-81ec-ef4a895fb208`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:38:56,874::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:38:56,895::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f170a097-7728-4a39-b7a3-936730ad14ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:38:56,896::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:38:56,898::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:38:56,899::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f170a097-7728-4a39-b7a3-936730ad14ee`::Granted request
>Thread-34::DEBUG::2014-08-21 10:38:57,096::task::827::TaskManager.Task::(resourceAcquired) Task=`6b1f584a-715f-4aee-81ec-ef4a895fb208`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:38:57,104::task::990::TaskManager.Task::(_decref) Task=`6b1f584a-715f-4aee-81ec-ef4a895fb208`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:38:57,225::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:57,230::task::1185::TaskManager.Task::(prepare) Task=`6b1f584a-715f-4aee-81ec-ef4a895fb208`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:38:57,235::task::595::TaskManager.Task::(_updateState) Task=`6b1f584a-715f-4aee-81ec-ef4a895fb208`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:38:57,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:38:57,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:38:57,270::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:38:57,273::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:38:57,275::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:38:57,297::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-15::DEBUG::2014-08-21 10:38:57,330::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:38:57,340::task::990::TaskManager.Task::(_decref) Task=`6b1f584a-715f-4aee-81ec-ef4a895fb208`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:38:57,375::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00185659 s, 268 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:57,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.16339 s, 324 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:38:59,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:03,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.201034 s, 5.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:39:05,074::task::595::TaskManager.Task::(_updateState) Task=`39aade90-8563-45ac-9455-602bf848e04c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:39:05,075::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:39:05,075::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00185659', 'lastCheck': '7.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:39:05,075::task::1185::TaskManager.Task::(prepare) Task=`39aade90-8563-45ac-9455-602bf848e04c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00185659', 'lastCheck': '7.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:39:05,076::task::595::TaskManager.Task::(_updateState) Task=`39aade90-8563-45ac-9455-602bf848e04c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:39:05,076::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:39:05,076::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:39:05,076::task::990::TaskManager.Task::(_decref) Task=`39aade90-8563-45ac-9455-602bf848e04c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:39:05,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:05,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0792878 s, 12.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:07,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:39:07,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-13::DEBUG::2014-08-21 10:39:07,360::task::595::TaskManager.Task::(_updateState) Task=`56532c45-4ba6-447e-ace5-6795deb0c90e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:39:07,360::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:39:07,361::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:39:07,361::task::1185::TaskManager.Task::(prepare) Task=`56532c45-4ba6-447e-ace5-6795deb0c90e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:39:07,361::task::595::TaskManager.Task::(_updateState) Task=`56532c45-4ba6-447e-ace5-6795deb0c90e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:39:07,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:39:07,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:39:07,362::task::990::TaskManager.Task::(_decref) Task=`56532c45-4ba6-447e-ace5-6795deb0c90e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:39:07,367::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 10:39:07,368::task::595::TaskManager.Task::(_updateState) Task=`76528128-35dd-4f18-911f-3c8ac8d93995`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:39:07,368::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:39:07,369::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3d4899b6-6175-4716-9ec8-74cda81c6675`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:39:07,369::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:39:07,370::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:39:07,370::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3d4899b6-6175-4716-9ec8-74cda81c6675`::Granted request
>Thread-34::DEBUG::2014-08-21 10:39:07,371::task::827::TaskManager.Task::(resourceAcquired) Task=`76528128-35dd-4f18-911f-3c8ac8d93995`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:39:07,371::task::990::TaskManager.Task::(_decref) Task=`76528128-35dd-4f18-911f-3c8ac8d93995`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:39:07,375::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:07,376::task::1185::TaskManager.Task::(prepare) Task=`76528128-35dd-4f18-911f-3c8ac8d93995`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:07,376::task::595::TaskManager.Task::(_updateState) Task=`76528128-35dd-4f18-911f-3c8ac8d93995`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:39:07,376::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:39:07,376::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:39:07,377::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:39:07,377::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:39:07,377::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:39:07,377::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:39:07,377::task::990::TaskManager.Task::(_decref) Task=`76528128-35dd-4f18-911f-3c8ac8d93995`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:39:07,474::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:39:07,509::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00131029 s, 380 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:07,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.231046 s, 4.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:09,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:09,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101413 s, 10.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:11,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:12,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552562 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:14,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:14,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178289 s, 5.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:16,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:39:17,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-26::DEBUG::2014-08-21 10:39:17,458::task::595::TaskManager.Task::(_updateState) Task=`a29e0f33-5277-4385-87de-68d5d960bc84`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:39:17,458::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:39:17,459::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:17,459::task::1185::TaskManager.Task::(prepare) Task=`a29e0f33-5277-4385-87de-68d5d960bc84`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:17,459::task::595::TaskManager.Task::(_updateState) Task=`a29e0f33-5277-4385-87de-68d5d960bc84`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:39:17,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:39:17,460::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:39:17,460::task::990::TaskManager.Task::(_decref) Task=`a29e0f33-5277-4385-87de-68d5d960bc84`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:39:17,490::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 10:39:17,491::task::595::TaskManager.Task::(_updateState) Task=`56cbec02-38b3-4bb1-8147-229022c9d4d2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:39:17,492::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:39:17,496::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3fbd602c-6009-4802-b7d2-747058096ea9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:39:17,497::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:39:17,498::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:39:17,498::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3fbd602c-6009-4802-b7d2-747058096ea9`::Granted request
>Thread-34::DEBUG::2014-08-21 10:39:17,498::task::827::TaskManager.Task::(resourceAcquired) Task=`56cbec02-38b3-4bb1-8147-229022c9d4d2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:39:17,499::task::990::TaskManager.Task::(_decref) Task=`56cbec02-38b3-4bb1-8147-229022c9d4d2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:39:17,504::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:17,504::task::1185::TaskManager.Task::(prepare) Task=`56cbec02-38b3-4bb1-8147-229022c9d4d2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:17,504::task::595::TaskManager.Task::(_updateState) Task=`56cbec02-38b3-4bb1-8147-229022c9d4d2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:39:17,504::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:39:17,505::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:39:17,505::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:39:17,505::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:39:17,505::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:39:17,506::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:39:17,506::task::990::TaskManager.Task::(_decref) Task=`56cbec02-38b3-4bb1-8147-229022c9d4d2`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:39:17,698::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:39:17,736::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000541134 s, 920 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:18,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.7961 s, 570 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:39:20,464::task::595::TaskManager.Task::(_updateState) Task=`30de040d-0541-4b90-966f-5e81b93e901e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:39:20,465::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:39:20,466::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541134', 'lastCheck': '2.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:39:20,466::task::1185::TaskManager.Task::(prepare) Task=`30de040d-0541-4b90-966f-5e81b93e901e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541134', 'lastCheck': '2.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:39:20,467::task::595::TaskManager.Task::(_updateState) Task=`30de040d-0541-4b90-966f-5e81b93e901e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:39:20,467::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:39:20,467::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:39:20,468::task::990::TaskManager.Task::(_decref) Task=`30de040d-0541-4b90-966f-5e81b93e901e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:39:20,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:20,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459893 s, 22.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:22,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:22,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.067578 s, 15.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:24,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:24,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0567811 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:26,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:27,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.130106 s, 7.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:39:27,568::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-26::DEBUG::2014-08-21 10:39:27,570::task::595::TaskManager.Task::(_updateState) Task=`8957155d-8a78-4d62-8d68-5bc2126babae`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:39:27,570::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:39:27,571::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:27,571::task::1185::TaskManager.Task::(prepare) Task=`8957155d-8a78-4d62-8d68-5bc2126babae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:27,571::task::595::TaskManager.Task::(_updateState) Task=`8957155d-8a78-4d62-8d68-5bc2126babae`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:39:27,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:39:27,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:39:27,572::task::990::TaskManager.Task::(_decref) Task=`8957155d-8a78-4d62-8d68-5bc2126babae`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:39:27,578::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-34::DEBUG::2014-08-21 10:39:27,578::task::595::TaskManager.Task::(_updateState) Task=`a03ee53e-3394-4e8a-94d4-ad428c542ffb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:39:27,579::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:39:27,580::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3afc683a-1621-4c8a-8bd1-1913c78b3cc8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:39:27,580::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:39:27,581::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:39:27,581::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3afc683a-1621-4c8a-8bd1-1913c78b3cc8`::Granted request
>Thread-34::DEBUG::2014-08-21 10:39:27,582::task::827::TaskManager.Task::(resourceAcquired) Task=`a03ee53e-3394-4e8a-94d4-ad428c542ffb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:39:27,582::task::990::TaskManager.Task::(_decref) Task=`a03ee53e-3394-4e8a-94d4-ad428c542ffb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:39:27,586::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:27,587::task::1185::TaskManager.Task::(prepare) Task=`a03ee53e-3394-4e8a-94d4-ad428c542ffb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:27,587::task::595::TaskManager.Task::(_updateState) Task=`a03ee53e-3394-4e8a-94d4-ad428c542ffb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:39:27,587::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:39:27,588::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:39:27,588::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:39:27,589::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:39:27,589::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:39:27,589::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:39:27,590::task::990::TaskManager.Task::(_decref) Task=`a03ee53e-3394-4e8a-94d4-ad428c542ffb`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:39:28,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:39:28,508::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000567796 s, 877 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:29,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:31,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.78045 s, 575 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:33,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:35,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.10379 s, 928 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:39:36,431::task::595::TaskManager.Task::(_updateState) Task=`6b87c342-95d9-4a68-b6c0-341c4894702d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:39:36,432::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:39:36,432::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567796', 'lastCheck': '7.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:39:36,433::task::1185::TaskManager.Task::(prepare) Task=`6b87c342-95d9-4a68-b6c0-341c4894702d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567796', 'lastCheck': '7.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:39:36,433::task::595::TaskManager.Task::(_updateState) Task=`6b87c342-95d9-4a68-b6c0-341c4894702d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:39:36,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:39:36,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:39:36,434::task::990::TaskManager.Task::(_decref) Task=`6b87c342-95d9-4a68-b6c0-341c4894702d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:39:37,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:39:37,663::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-26::DEBUG::2014-08-21 10:39:37,665::task::595::TaskManager.Task::(_updateState) Task=`a531e37c-02cb-4dbb-a131-82b83833c2cb`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:39:37,666::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:39:37,667::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:37,668::task::1185::TaskManager.Task::(prepare) Task=`a531e37c-02cb-4dbb-a131-82b83833c2cb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:37,668::task::595::TaskManager.Task::(_updateState) Task=`a531e37c-02cb-4dbb-a131-82b83833c2cb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:39:37,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:39:37,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:39:37,669::task::990::TaskManager.Task::(_decref) Task=`a531e37c-02cb-4dbb-a131-82b83833c2cb`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:39:37,711::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-34::DEBUG::2014-08-21 10:39:37,715::task::595::TaskManager.Task::(_updateState) Task=`a503605e-b08b-491d-80fd-1e156c93a634`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:39:37,716::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:39:37,719::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`79f8f8de-8448-4370-b39a-dd821a505681`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:39:37,719::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:39:37,719::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:39:37,720::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`79f8f8de-8448-4370-b39a-dd821a505681`::Granted request
>Thread-34::DEBUG::2014-08-21 10:39:37,729::task::827::TaskManager.Task::(resourceAcquired) Task=`a503605e-b08b-491d-80fd-1e156c93a634`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:39:37,730::task::990::TaskManager.Task::(_decref) Task=`a503605e-b08b-491d-80fd-1e156c93a634`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:39:37,755::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:37,756::task::1185::TaskManager.Task::(prepare) Task=`a503605e-b08b-491d-80fd-1e156c93a634`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:37,756::task::595::TaskManager.Task::(_updateState) Task=`a503605e-b08b-491d-80fd-1e156c93a634`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:39:37,757::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:39:37,757::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:39:37,757::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:39:37,793::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:39:37,794::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:39:37,794::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:39:37,795::task::990::TaskManager.Task::(_decref) Task=`a503605e-b08b-491d-80fd-1e156c93a634`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:39:38,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.835766 s, 1.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:39:38,673::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:39:38,699::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000675251 s, 738 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:40,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:40,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0673117 s, 15.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:42,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:42,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0599237 s, 17.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:44,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:45,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137056 s, 7.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:47,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:47,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0601834 s, 17.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:39:47,982::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-26::DEBUG::2014-08-21 10:39:47,984::task::595::TaskManager.Task::(_updateState) Task=`72973e15-0bed-42d6-be43-39b7beeb5ded`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:39:47,984::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:39:47,985::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:47,985::task::1185::TaskManager.Task::(prepare) Task=`72973e15-0bed-42d6-be43-39b7beeb5ded`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:47,985::task::595::TaskManager.Task::(_updateState) Task=`72973e15-0bed-42d6-be43-39b7beeb5ded`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:39:47,985::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:39:47,985::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:39:47,986::task::990::TaskManager.Task::(_decref) Task=`72973e15-0bed-42d6-be43-39b7beeb5ded`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:39:47,990::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 10:39:47,990::task::595::TaskManager.Task::(_updateState) Task=`2ff9d854-6223-443d-9fbd-2bd66e7b35f0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:39:47,991::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:39:47,991::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a7304564-ad8b-44f4-8b29-2d8b17f8f1b3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:39:47,991::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:39:47,992::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:39:47,992::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a7304564-ad8b-44f4-8b29-2d8b17f8f1b3`::Granted request
>Thread-34::DEBUG::2014-08-21 10:39:47,992::task::827::TaskManager.Task::(resourceAcquired) Task=`2ff9d854-6223-443d-9fbd-2bd66e7b35f0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:39:47,992::task::990::TaskManager.Task::(_decref) Task=`2ff9d854-6223-443d-9fbd-2bd66e7b35f0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:39:47,996::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:47,996::task::1185::TaskManager.Task::(prepare) Task=`2ff9d854-6223-443d-9fbd-2bd66e7b35f0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:39:47,996::task::595::TaskManager.Task::(_updateState) Task=`2ff9d854-6223-443d-9fbd-2bd66e7b35f0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:39:47,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:39:47,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:39:47,997::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:39:47,997::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:39:47,997::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:39:47,998::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:39:47,998::task::990::TaskManager.Task::(_decref) Task=`2ff9d854-6223-443d-9fbd-2bd66e7b35f0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:39:48,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:39:48,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000871585 s, 571 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:49,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:39:49,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.097981 s, 10.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:51,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:39:51,790::task::595::TaskManager.Task::(_updateState) Task=`b3ae080e-eeff-4799-b523-4bcd449a460e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:39:51,791::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:39:51,791::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000871585', 'lastCheck': '3.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:39:51,791::task::1185::TaskManager.Task::(prepare) Task=`b3ae080e-eeff-4799-b523-4bcd449a460e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000871585', 'lastCheck': '3.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:39:51,791::task::595::TaskManager.Task::(_updateState) Task=`b3ae080e-eeff-4799-b523-4bcd449a460e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:39:51,792::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:39:51,792::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:39:51,792::task::990::TaskManager.Task::(_decref) Task=`b3ae080e-eeff-4799-b523-4bcd449a460e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:39:52,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.940556 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:39:54,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:39:58,020::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5382417d]
>Thread-26::DEBUG::2014-08-21 10:39:58,021::task::595::TaskManager.Task::(_updateState) Task=`559a1246-439d-4350-a0e1-262f9f3e1ba4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:39:58,031::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:39:58,033::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:58,033::task::1185::TaskManager.Task::(prepare) Task=`559a1246-439d-4350-a0e1-262f9f3e1ba4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:39:58,033::task::595::TaskManager.Task::(_updateState) Task=`559a1246-439d-4350-a0e1-262f9f3e1ba4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:39:58,034::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:39:58,034::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:39:58,035::task::990::TaskManager.Task::(_decref) Task=`559a1246-439d-4350-a0e1-262f9f3e1ba4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:39:58,679::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5382417d]
>Thread-34::DEBUG::2014-08-21 10:39:58,680::task::595::TaskManager.Task::(_updateState) Task=`ee4bf3a0-041e-460d-a6df-f7676c135ceb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:39:58,681::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:39:58,751::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`28927611-ed68-4e3b-824f-4b7ea231fe1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:39:58,752::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:39:58,753::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:39:58,753::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`28927611-ed68-4e3b-824f-4b7ea231fe1c`::Granted request
>Thread-34::DEBUG::2014-08-21 10:39:58,923::task::827::TaskManager.Task::(resourceAcquired) Task=`ee4bf3a0-041e-460d-a6df-f7676c135ceb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:39:59,735::task::990::TaskManager.Task::(_decref) Task=`ee4bf3a0-041e-460d-a6df-f7676c135ceb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:40:01,043::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:01,184::task::1185::TaskManager.Task::(prepare) Task=`ee4bf3a0-041e-460d-a6df-f7676c135ceb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:01,192::task::595::TaskManager.Task::(_updateState) Task=`ee4bf3a0-041e-460d-a6df-f7676c135ceb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:40:01,200::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:40:01,210::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:40:01,373::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:40:01,543::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:40:01,544::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:40:01,544::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:40:01,545::task::990::TaskManager.Task::(_decref) Task=`ee4bf3a0-041e-460d-a6df-f7676c135ceb`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:40:01,567::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:40:01,881::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.103184 s, 4.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:08,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.8402 s, 267 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:10,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:40:10,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.396947 s, 2.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:40:12,573::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-26::DEBUG::2014-08-21 10:40:12,574::task::595::TaskManager.Task::(_updateState) Task=`2da1b01e-a392-4d75-96d7-48569f4f5127`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:40:12,575::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:40:12,575::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:40:12,576::task::1185::TaskManager.Task::(prepare) Task=`2da1b01e-a392-4d75-96d7-48569f4f5127`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:40:12,576::task::595::TaskManager.Task::(_updateState) Task=`2da1b01e-a392-4d75-96d7-48569f4f5127`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:40:12,576::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:40:12,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:40:12,577::task::990::TaskManager.Task::(_decref) Task=`2da1b01e-a392-4d75-96d7-48569f4f5127`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:40:12,584::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-34::DEBUG::2014-08-21 10:40:12,585::task::595::TaskManager.Task::(_updateState) Task=`132b3864-fbb7-4c21-9e2d-89eb304d4ad4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:40:12,585::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:40:12,586::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b788da46-3f1b-4ce3-8cdc-1505e3a63373`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:40:12,586::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:40:12,586::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:40:12,587::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b788da46-3f1b-4ce3-8cdc-1505e3a63373`::Granted request
>Thread-34::DEBUG::2014-08-21 10:40:12,587::task::827::TaskManager.Task::(resourceAcquired) Task=`132b3864-fbb7-4c21-9e2d-89eb304d4ad4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:40:12,587::task::990::TaskManager.Task::(_decref) Task=`132b3864-fbb7-4c21-9e2d-89eb304d4ad4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:40:12,592::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:12,592::task::1185::TaskManager.Task::(prepare) Task=`132b3864-fbb7-4c21-9e2d-89eb304d4ad4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:12,593::task::595::TaskManager.Task::(_updateState) Task=`132b3864-fbb7-4c21-9e2d-89eb304d4ad4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:40:12,593::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:40:12,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:40:12,594::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:40:12,594::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:40:12,595::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:40:12,595::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:40:12,595::task::990::TaskManager.Task::(_decref) Task=`132b3864-fbb7-4c21-9e2d-89eb304d4ad4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:40:13,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:40:13,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0568257 s, 18.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:40:14,106::task::595::TaskManager.Task::(_updateState) Task=`8e50b104-df73-4c04-a5fb-48f032ed04e0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:40:14,106::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:40:14,107::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.103184', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:40:14,107::task::1185::TaskManager.Task::(prepare) Task=`8e50b104-df73-4c04-a5fb-48f032ed04e0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.103184', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:40:14,108::task::595::TaskManager.Task::(_updateState) Task=`8e50b104-df73-4c04-a5fb-48f032ed04e0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:40:14,108::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:40:14,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:40:14,109::task::990::TaskManager.Task::(_decref) Task=`8e50b104-df73-4c04-a5fb-48f032ed04e0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:40:15,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:40:15,337::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:40:15,361::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000642021 s, 776 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:15,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0988286 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:17,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:40:18,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.451745 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:20,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:40:21,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.496592 s, 2.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:40:22,620::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-26::DEBUG::2014-08-21 10:40:22,621::task::595::TaskManager.Task::(_updateState) Task=`e17ff816-7c0a-4fed-a001-8b5e1df491b4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:40:22,622::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:40:22,623::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:40:22,624::task::1185::TaskManager.Task::(prepare) Task=`e17ff816-7c0a-4fed-a001-8b5e1df491b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:40:22,625::task::595::TaskManager.Task::(_updateState) Task=`e17ff816-7c0a-4fed-a001-8b5e1df491b4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:40:22,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:40:22,625::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:40:22,626::task::990::TaskManager.Task::(_decref) Task=`e17ff816-7c0a-4fed-a001-8b5e1df491b4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:40:22,714::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-34::DEBUG::2014-08-21 10:40:22,715::task::595::TaskManager.Task::(_updateState) Task=`8cb35fac-4a17-4a26-b572-a1b059051701`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:40:22,716::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 10:40:23,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:40:23,284::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f344ff90-9e3a-4340-9bfb-0b6b12b93e8b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:40:23,285::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:40:23,306::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:40:23,307::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f344ff90-9e3a-4340-9bfb-0b6b12b93e8b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:40:23,410::task::827::TaskManager.Task::(resourceAcquired) Task=`8cb35fac-4a17-4a26-b572-a1b059051701`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:40:23,410::task::990::TaskManager.Task::(_decref) Task=`8cb35fac-4a17-4a26-b572-a1b059051701`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:40:23,435::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:23,436::task::1185::TaskManager.Task::(prepare) Task=`8cb35fac-4a17-4a26-b572-a1b059051701`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:23,438::task::595::TaskManager.Task::(_updateState) Task=`8cb35fac-4a17-4a26-b572-a1b059051701`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:40:23,443::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:40:23,444::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:40:23,445::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:40:23,446::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:40:23,446::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:40:23,446::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:40:23,447::task::990::TaskManager.Task::(_decref) Task=`8cb35fac-4a17-4a26-b572-a1b059051701`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:40:23,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.242661 s, 4.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:40:25,418::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:40:27,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:40:29,190::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00293801 s, 170 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:40:34,135::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-26::DEBUG::2014-08-21 10:40:34,226::task::595::TaskManager.Task::(_updateState) Task=`55db3142-973a-4d16-b8bf-bcd9cf33666b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:40:34,227::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:40:34,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:40:34,362::task::595::TaskManager.Task::(_updateState) Task=`0c64dbbd-b394-4b87-9099-5c806e1eab0f`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 10:40:34,363::task::1185::TaskManager.Task::(prepare) Task=`55db3142-973a-4d16-b8bf-bcd9cf33666b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:40:34,363::task::595::TaskManager.Task::(_updateState) Task=`55db3142-973a-4d16-b8bf-bcd9cf33666b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:40:34,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:40:34,385::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::INFO::2014-08-21 10:40:34,583::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:40:34,583::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00293801', 'lastCheck': '3.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:40:34,643::task::990::TaskManager.Task::(_decref) Task=`55db3142-973a-4d16-b8bf-bcd9cf33666b`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:40:34,927::task::1185::TaskManager.Task::(prepare) Task=`0c64dbbd-b394-4b87-9099-5c806e1eab0f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00293801', 'lastCheck': '3.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:40:34,928::task::595::TaskManager.Task::(_updateState) Task=`0c64dbbd-b394-4b87-9099-5c806e1eab0f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:40:34,928::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:40:34,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:40:34,929::task::990::TaskManager.Task::(_decref) Task=`0c64dbbd-b394-4b87-9099-5c806e1eab0f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:40:35,012::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-34::DEBUG::2014-08-21 10:40:35,013::task::595::TaskManager.Task::(_updateState) Task=`cbcd1b35-46d8-4c67-8820-20984e391424`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:40:35,014::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:40:35,025::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7de3f1be-e389-43c5-a502-ce3d031d5730`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:40:35,026::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:40:35,026::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:40:35,027::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7de3f1be-e389-43c5-a502-ce3d031d5730`::Granted request
>Thread-34::DEBUG::2014-08-21 10:40:35,028::task::827::TaskManager.Task::(resourceAcquired) Task=`cbcd1b35-46d8-4c67-8820-20984e391424`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:40:35,028::task::990::TaskManager.Task::(_decref) Task=`cbcd1b35-46d8-4c67-8820-20984e391424`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:40:35,121::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:35,122::task::1185::TaskManager.Task::(prepare) Task=`cbcd1b35-46d8-4c67-8820-20984e391424`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:35,122::task::595::TaskManager.Task::(_updateState) Task=`cbcd1b35-46d8-4c67-8820-20984e391424`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:40:35,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:40:35,124::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:40:35,130::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:40:35,136::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:40:35,137::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:40:35,138::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:40:35,138::task::990::TaskManager.Task::(_decref) Task=`cbcd1b35-46d8-4c67-8820-20984e391424`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:40:35,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.87058 s, 130 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:37,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:40:38,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0654216 s, 15.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:40,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:40:42,182::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:40:42,278::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00222938 s, 223 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:42,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.16864 s, 472 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:44,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:40:48,830::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [ffadda0]
>Thread-26::DEBUG::2014-08-21 10:40:48,849::task::595::TaskManager.Task::(_updateState) Task=`4c6b8bd6-8957-4186-9be7-2fd59eebe8ef`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:40:48,974::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:40:48,976::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:40:48,988::task::1185::TaskManager.Task::(prepare) Task=`4c6b8bd6-8957-4186-9be7-2fd59eebe8ef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:40:48,990::task::595::TaskManager.Task::(_updateState) Task=`4c6b8bd6-8957-4186-9be7-2fd59eebe8ef`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:40:48,991::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:40:49,327::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:40:49,467::task::990::TaskManager.Task::(_decref) Task=`4c6b8bd6-8957-4186-9be7-2fd59eebe8ef`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:40:49,637::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [ffadda0]
>Thread-34::DEBUG::2014-08-21 10:40:49,638::task::595::TaskManager.Task::(_updateState) Task=`75a6b923-0354-49be-83c0-54c6a5fdd3e1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:40:49,640::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:40:49,642::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0558cee4-df66-497c-a188-5873a7a85e87`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:40:49,642::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:40:49,643::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:40:49,644::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0558cee4-df66-497c-a188-5873a7a85e87`::Granted request
>Thread-34::DEBUG::2014-08-21 10:40:49,645::task::827::TaskManager.Task::(resourceAcquired) Task=`75a6b923-0354-49be-83c0-54c6a5fdd3e1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:40:49,648::task::990::TaskManager.Task::(_decref) Task=`75a6b923-0354-49be-83c0-54c6a5fdd3e1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:40:49,708::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:49,708::task::1185::TaskManager.Task::(prepare) Task=`75a6b923-0354-49be-83c0-54c6a5fdd3e1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:40:49,709::task::595::TaskManager.Task::(_updateState) Task=`75a6b923-0354-49be-83c0-54c6a5fdd3e1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:40:49,710::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:40:49,710::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:40:49,727::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:40:49,730::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:40:49,734::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:40:49,745::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:40:49,751::task::990::TaskManager.Task::(_decref) Task=`75a6b923-0354-49be-83c0-54c6a5fdd3e1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:40:50,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.56859 s, 653 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:40:52,803::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:40:52,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:40:52,988::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000779595 s, 639 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:53,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.154618 s, 6.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:40:55,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:40:56,118::task::595::TaskManager.Task::(_updateState) Task=`f54edbc1-7296-489c-a286-a36bc59d035b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:40:56,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:40:56,183::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779595', 'lastCheck': '3.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:40:56,184::task::1185::TaskManager.Task::(prepare) Task=`f54edbc1-7296-489c-a286-a36bc59d035b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779595', 'lastCheck': '3.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:40:56,184::task::595::TaskManager.Task::(_updateState) Task=`f54edbc1-7296-489c-a286-a36bc59d035b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:40:56,185::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:40:56,199::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:40:56,200::task::990::TaskManager.Task::(_decref) Task=`f54edbc1-7296-489c-a286-a36bc59d035b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:40:58,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0963689 s, 10.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:40:59,959::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-26::DEBUG::2014-08-21 10:41:00,478::task::595::TaskManager.Task::(_updateState) Task=`5fe88283-a609-4bb7-b551-0595af0e7fb3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:41:00,479::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:41:00,481::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:41:00,482::task::1185::TaskManager.Task::(prepare) Task=`5fe88283-a609-4bb7-b551-0595af0e7fb3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:41:00,483::task::595::TaskManager.Task::(_updateState) Task=`5fe88283-a609-4bb7-b551-0595af0e7fb3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:41:00,483::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:41:00,484::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:41:00,488::task::990::TaskManager.Task::(_decref) Task=`5fe88283-a609-4bb7-b551-0595af0e7fb3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:41:01,055::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-34::DEBUG::2014-08-21 10:41:01,056::task::595::TaskManager.Task::(_updateState) Task=`c99288f0-8e7a-43ca-bb59-09ed636264bb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:41:01,056::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:41:01,057::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`32f17c77-337a-4715-a84d-bb6da3e14ff5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:41:01,057::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:41:01,057::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:41:01,058::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`32f17c77-337a-4715-a84d-bb6da3e14ff5`::Granted request
>Thread-34::DEBUG::2014-08-21 10:41:01,058::task::827::TaskManager.Task::(resourceAcquired) Task=`c99288f0-8e7a-43ca-bb59-09ed636264bb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:41:01,058::task::990::TaskManager.Task::(_decref) Task=`c99288f0-8e7a-43ca-bb59-09ed636264bb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:41:01,062::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896981504', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:01,063::task::1185::TaskManager.Task::(prepare) Task=`c99288f0-8e7a-43ca-bb59-09ed636264bb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896981504', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:01,063::task::595::TaskManager.Task::(_updateState) Task=`c99288f0-8e7a-43ca-bb59-09ed636264bb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:41:01,063::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:41:01,063::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:41:01,064::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:41:01,064::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:41:01,064::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:41:01,064::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:41:01,065::task::990::TaskManager.Task::(_decref) Task=`c99288f0-8e7a-43ca-bb59-09ed636264bb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:41:01,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:01,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0881542 s, 11.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:41:03,036::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:41:03,059::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000515163 s, 967 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:03,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:03,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0717044 s, 14.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:05,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:05,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048234 s, 21.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:07,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:08,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.165034 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:10,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:10,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494171 s, 20.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:41:11,110::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-26::DEBUG::2014-08-21 10:41:11,111::task::595::TaskManager.Task::(_updateState) Task=`cdcba575-4798-46f0-85a3-98e775300ee2`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:41:11,111::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:41:11,112::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:41:11,112::task::1185::TaskManager.Task::(prepare) Task=`cdcba575-4798-46f0-85a3-98e775300ee2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:41:11,112::task::595::TaskManager.Task::(_updateState) Task=`cdcba575-4798-46f0-85a3-98e775300ee2`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:41:11,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:41:11,113::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:41:11,113::task::990::TaskManager.Task::(_decref) Task=`cdcba575-4798-46f0-85a3-98e775300ee2`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:41:11,117::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 10:41:11,118::task::595::TaskManager.Task::(_updateState) Task=`2f89d581-622c-49d4-98b6-ec81bcf64363`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:41:11,118::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:41:11,119::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5c83c2c0-f1fe-4e21-9e71-5f9db0f53c88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:41:11,119::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:41:11,120::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:41:11,120::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5c83c2c0-f1fe-4e21-9e71-5f9db0f53c88`::Granted request
>Thread-34::DEBUG::2014-08-21 10:41:11,121::task::827::TaskManager.Task::(resourceAcquired) Task=`2f89d581-622c-49d4-98b6-ec81bcf64363`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:41:11,121::task::990::TaskManager.Task::(_decref) Task=`2f89d581-622c-49d4-98b6-ec81bcf64363`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:41:11,126::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:11,126::task::1185::TaskManager.Task::(prepare) Task=`2f89d581-622c-49d4-98b6-ec81bcf64363`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:11,127::task::595::TaskManager.Task::(_updateState) Task=`2f89d581-622c-49d4-98b6-ec81bcf64363`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:41:11,127::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:41:11,127::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:41:11,128::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:41:11,128::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:41:11,128::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:41:11,128::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:41:11,128::task::990::TaskManager.Task::(_decref) Task=`2f89d581-622c-49d4-98b6-ec81bcf64363`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:41:12,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:12,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049989 s, 20.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:41:13,081::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:41:13,096::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000715425 s, 696 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:41:13,577::task::595::TaskManager.Task::(_updateState) Task=`beb44c51-5aa6-40b1-a485-a1e1ea08e0eb`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:41:13,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:41:13,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715425', 'lastCheck': '0.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:41:13,578::task::1185::TaskManager.Task::(prepare) Task=`beb44c51-5aa6-40b1-a485-a1e1ea08e0eb`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715425', 'lastCheck': '0.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:41:13,578::task::595::TaskManager.Task::(_updateState) Task=`beb44c51-5aa6-40b1-a485-a1e1ea08e0eb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:41:13,579::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:41:13,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:41:13,579::task::990::TaskManager.Task::(_decref) Task=`beb44c51-5aa6-40b1-a485-a1e1ea08e0eb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:41:14,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:14,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.069099 s, 14.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:16,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:16,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0747461 s, 13.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:18,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:41:21,409::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-13::DEBUG::2014-08-21 10:41:21,411::task::595::TaskManager.Task::(_updateState) Task=`d01cf172-5d83-4d9a-b38d-50260e148ed6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:41:21,412::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:41:21,413::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:41:21,414::task::1185::TaskManager.Task::(prepare) Task=`d01cf172-5d83-4d9a-b38d-50260e148ed6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:41:21,414::task::595::TaskManager.Task::(_updateState) Task=`d01cf172-5d83-4d9a-b38d-50260e148ed6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:41:21,415::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:41:21,416::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:41:21,434::task::990::TaskManager.Task::(_decref) Task=`d01cf172-5d83-4d9a-b38d-50260e148ed6`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:41:21,855::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-34::DEBUG::2014-08-21 10:41:21,857::task::595::TaskManager.Task::(_updateState) Task=`a5686b82-4904-4b76-9424-302cdfdf01c4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:41:21,886::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:41:21,888::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`99f07ff2-6c2f-454f-8c43-147be176e86e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:41:21,888::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:41:22,307::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:41:22,310::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`99f07ff2-6c2f-454f-8c43-147be176e86e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:41:22,324::task::827::TaskManager.Task::(resourceAcquired) Task=`a5686b82-4904-4b76-9424-302cdfdf01c4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:41:22,326::task::990::TaskManager.Task::(_decref) Task=`a5686b82-4904-4b76-9424-302cdfdf01c4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:41:22,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897112576', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:22,652::task::1185::TaskManager.Task::(prepare) Task=`a5686b82-4904-4b76-9424-302cdfdf01c4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897112576', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:22,653::task::595::TaskManager.Task::(_updateState) Task=`a5686b82-4904-4b76-9424-302cdfdf01c4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:41:22,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:41:22,657::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:41:22,660::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:41:22,663::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:41:22,665::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:41:22,668::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:41:22,673::task::990::TaskManager.Task::(_decref) Task=`a5686b82-4904-4b76-9424-302cdfdf01c4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:41:23,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:41:25,715::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0486818 s, 10.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:30,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.92997 s, 261 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:41:32,766::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Dummy-33::DEBUG::2014-08-21 10:41:33,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:41:34,203::task::595::TaskManager.Task::(_updateState) Task=`63de05c0-6f1c-42ef-954b-e785789e7194`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:41:34,204::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:41:34,218::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0486818', 'lastCheck': '7.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:41:34,219::task::1185::TaskManager.Task::(prepare) Task=`63de05c0-6f1c-42ef-954b-e785789e7194`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0486818', 'lastCheck': '7.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:41:34,219::task::595::TaskManager.Task::(_updateState) Task=`63de05c0-6f1c-42ef-954b-e785789e7194`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:41:34,220::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:41:34,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:41:34,220::task::990::TaskManager.Task::(_decref) Task=`63de05c0-6f1c-42ef-954b-e785789e7194`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:41:34,323::task::595::TaskManager.Task::(_updateState) Task=`05af6253-2666-4375-aff1-cdc97af5cfdb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:41:34,324::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:41:34,324::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:41:34,325::task::1185::TaskManager.Task::(prepare) Task=`05af6253-2666-4375-aff1-cdc97af5cfdb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:41:34,325::task::595::TaskManager.Task::(_updateState) Task=`05af6253-2666-4375-aff1-cdc97af5cfdb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:41:34,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:41:34,326::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:41:34,326::task::990::TaskManager.Task::(_decref) Task=`05af6253-2666-4375-aff1-cdc97af5cfdb`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:41:34,453::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-34::DEBUG::2014-08-21 10:41:34,467::task::595::TaskManager.Task::(_updateState) Task=`61253028-0661-418a-ba55-482061373d1c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:41:34,468::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:41:34,469::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b909f389-6fa1-42a1-8280-e421d72d67a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:41:34,469::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:41:34,470::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:41:34,470::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b909f389-6fa1-42a1-8280-e421d72d67a1`::Granted request
>Thread-34::DEBUG::2014-08-21 10:41:34,471::task::827::TaskManager.Task::(resourceAcquired) Task=`61253028-0661-418a-ba55-482061373d1c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:41:34,471::task::990::TaskManager.Task::(_decref) Task=`61253028-0661-418a-ba55-482061373d1c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:41:34,604::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:34,605::task::1185::TaskManager.Task::(prepare) Task=`61253028-0661-418a-ba55-482061373d1c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:34,605::task::595::TaskManager.Task::(_updateState) Task=`61253028-0661-418a-ba55-482061373d1c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:41:34,605::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:41:34,612::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:41:34,624::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:41:34,641::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:41:34,642::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:41:34,642::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:41:34,643::task::990::TaskManager.Task::(_decref) Task=`61253028-0661-418a-ba55-482061373d1c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:41:35,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.1679 s, 877 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:41:36,918::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:41:37,035::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00114981 s, 433 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:37,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:38,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.41103 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:40,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:41:45,164::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d519215]
>Thread-13::DEBUG::2014-08-21 10:41:45,173::task::595::TaskManager.Task::(_updateState) Task=`adfd7526-e022-4fbc-b46e-3e69cc553e1e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:41:45,386::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:41:45,387::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:41:45,387::task::1185::TaskManager.Task::(prepare) Task=`adfd7526-e022-4fbc-b46e-3e69cc553e1e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:41:45,388::task::595::TaskManager.Task::(_updateState) Task=`adfd7526-e022-4fbc-b46e-3e69cc553e1e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:41:45,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:41:45,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:41:45,399::task::990::TaskManager.Task::(_decref) Task=`adfd7526-e022-4fbc-b46e-3e69cc553e1e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:41:45,867::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d519215]
>Thread-34::DEBUG::2014-08-21 10:41:45,887::task::595::TaskManager.Task::(_updateState) Task=`da5a516a-efcc-4bc8-8e48-24ebdbf3937e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:41:45,891::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:41:45,954::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ea08990e-aa70-457c-8453-0b00c9c86690`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:41:45,971::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:41:46,067::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:41:46,120::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ea08990e-aa70-457c-8453-0b00c9c86690`::Granted request
>Thread-34::DEBUG::2014-08-21 10:41:46,196::task::827::TaskManager.Task::(resourceAcquired) Task=`da5a516a-efcc-4bc8-8e48-24ebdbf3937e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:41:46,249::task::990::TaskManager.Task::(_decref) Task=`da5a516a-efcc-4bc8-8e48-24ebdbf3937e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:41:46,525::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:46,532::task::1185::TaskManager.Task::(prepare) Task=`da5a516a-efcc-4bc8-8e48-24ebdbf3937e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896588288', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:46,536::task::595::TaskManager.Task::(_updateState) Task=`da5a516a-efcc-4bc8-8e48-24ebdbf3937e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:41:46,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:41:46,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:41:46,546::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:41:46,550::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:41:46,553::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:41:46,555::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:41:46,560::task::990::TaskManager.Task::(_decref) Task=`da5a516a-efcc-4bc8-8e48-24ebdbf3937e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:41:48,054::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:41:48,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00135498 s, 368 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:48,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.272 s, 313 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:50,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:50,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0851046 s, 12.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:52,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:52,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.320405 s, 3.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:41:54,492::task::595::TaskManager.Task::(_updateState) Task=`2cbc2b16-2b68-4e24-885c-b41d3ddfc5f2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:41:54,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:41:54,493::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00135498', 'lastCheck': '6.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:41:54,493::task::1185::TaskManager.Task::(prepare) Task=`2cbc2b16-2b68-4e24-885c-b41d3ddfc5f2`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00135498', 'lastCheck': '6.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:41:54,493::task::595::TaskManager.Task::(_updateState) Task=`2cbc2b16-2b68-4e24-885c-b41d3ddfc5f2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:41:54,494::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:41:54,494::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:41:54,494::task::990::TaskManager.Task::(_decref) Task=`2cbc2b16-2b68-4e24-885c-b41d3ddfc5f2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:41:54,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:54,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584924 s, 17.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:56,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:41:57,071::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-13::DEBUG::2014-08-21 10:41:57,076::task::595::TaskManager.Task::(_updateState) Task=`204c356c-5cb2-4267-8c68-94ab9a1bb428`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:41:57,079::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:41:57,102::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:41:57,106::task::1185::TaskManager.Task::(prepare) Task=`204c356c-5cb2-4267-8c68-94ab9a1bb428`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:41:57,107::task::595::TaskManager.Task::(_updateState) Task=`204c356c-5cb2-4267-8c68-94ab9a1bb428`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:41:57,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:41:57,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:41:57,113::task::990::TaskManager.Task::(_decref) Task=`204c356c-5cb2-4267-8c68-94ab9a1bb428`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:41:57,127::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 10:41:57,131::task::595::TaskManager.Task::(_updateState) Task=`6d8f0b06-ce4a-477b-8177-bfb3e309f45b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:41:57,134::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:41:57,140::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a5e5c45a-4f75-43f9-93e9-0627f89a154d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:41:57,141::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:41:57,144::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:41:57,145::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a5e5c45a-4f75-43f9-93e9-0627f89a154d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:41:57,148::task::827::TaskManager.Task::(resourceAcquired) Task=`6d8f0b06-ce4a-477b-8177-bfb3e309f45b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:41:57,149::task::990::TaskManager.Task::(_decref) Task=`6d8f0b06-ce4a-477b-8177-bfb3e309f45b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:41:57,182::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:57,183::task::1185::TaskManager.Task::(prepare) Task=`6d8f0b06-ce4a-477b-8177-bfb3e309f45b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:41:57,184::task::595::TaskManager.Task::(_updateState) Task=`6d8f0b06-ce4a-477b-8177-bfb3e309f45b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:41:57,185::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:41:57,186::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:41:57,187::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:41:57,188::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:41:57,189::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:41:57,190::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:41:57,190::task::990::TaskManager.Task::(_decref) Task=`6d8f0b06-ce4a-477b-8177-bfb3e309f45b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:41:57,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0644285 s, 15.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:41:58,217::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:41:58,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000433464 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:41:59,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:41:59,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104097 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:01,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:02,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.212713 s, 4.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:04,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:06,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.73933 s, 589 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:42:07,234::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-13::DEBUG::2014-08-21 10:42:07,273::task::595::TaskManager.Task::(_updateState) Task=`8f423927-05cc-454c-869e-92102450876d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:42:07,274::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:42:07,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:42:07,276::task::1185::TaskManager.Task::(prepare) Task=`8f423927-05cc-454c-869e-92102450876d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:42:07,276::task::595::TaskManager.Task::(_updateState) Task=`8f423927-05cc-454c-869e-92102450876d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:42:07,276::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:42:07,277::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:42:07,277::task::990::TaskManager.Task::(_decref) Task=`8f423927-05cc-454c-869e-92102450876d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:42:07,356::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 10:42:07,357::task::595::TaskManager.Task::(_updateState) Task=`cb591cfd-8dc2-4aea-8035-91fa4f396450`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:42:07,358::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:42:07,381::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c3b2e5f1-863b-4625-b0b8-9f19c6591675`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:42:07,419::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:42:07,441::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Dummy-33::DEBUG::2014-08-21 10:42:15,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:42:19,201::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c3b2e5f1-863b-4625-b0b8-9f19c6591675`::Granted request
>Thread-13::DEBUG::2014-08-21 10:42:19,226::task::595::TaskManager.Task::(_updateState) Task=`4673e5c3-a8d0-410b-9f18-2caa2ab91445`::moving from state init -> state preparing
>Thread-34::DEBUG::2014-08-21 10:42:19,226::task::827::TaskManager.Task::(resourceAcquired) Task=`cb591cfd-8dc2-4aea-8035-91fa4f396450`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-13::INFO::2014-08-21 10:42:19,227::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:42:19,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433464', 'lastCheck': '21.0', 'valid': True}}
>Thread-34::DEBUG::2014-08-21 10:42:19,266::task::990::TaskManager.Task::(_decref) Task=`cb591cfd-8dc2-4aea-8035-91fa4f396450`::ref 1 aborting False
>Thread-13::DEBUG::2014-08-21 10:42:19,267::task::1185::TaskManager.Task::(prepare) Task=`4673e5c3-a8d0-410b-9f18-2caa2ab91445`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433464', 'lastCheck': '21.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:42:19,269::task::595::TaskManager.Task::(_updateState) Task=`4673e5c3-a8d0-410b-9f18-2caa2ab91445`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:42:19,278::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:42:19,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:42:19,279::task::990::TaskManager.Task::(_decref) Task=`4673e5c3-a8d0-410b-9f18-2caa2ab91445`::ref 0 aborting False
>Thread-34::INFO::2014-08-21 10:42:19,317::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:42:19,319::task::1185::TaskManager.Task::(prepare) Task=`cb591cfd-8dc2-4aea-8035-91fa4f396450`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:42:19,320::task::595::TaskManager.Task::(_updateState) Task=`cb591cfd-8dc2-4aea-8035-91fa4f396450`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:42:19,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:42:19,321::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:42:19,323::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:42:19,323::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:42:19,324::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:42:19,324::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:42:19,326::task::990::TaskManager.Task::(_decref) Task=`cb591cfd-8dc2-4aea-8035-91fa4f396450`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:42:19,603::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:42:19,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00203601 s, 245 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:19,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.146666 s, 7.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:21,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:21,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0866509 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:23,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:24,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.082127 s, 12.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:26,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:26,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0613385 s, 16.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:28,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:28,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0605093 s, 16.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:42:29,613::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-13::DEBUG::2014-08-21 10:42:29,615::task::595::TaskManager.Task::(_updateState) Task=`1eb3e8e8-1097-4731-a9ed-aa42e4441c43`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:42:29,615::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:42:29,616::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:42:29,616::task::1185::TaskManager.Task::(prepare) Task=`1eb3e8e8-1097-4731-a9ed-aa42e4441c43`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:42:29,616::task::595::TaskManager.Task::(_updateState) Task=`1eb3e8e8-1097-4731-a9ed-aa42e4441c43`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:42:29,616::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:42:29,616::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:42:29,617::task::990::TaskManager.Task::(_decref) Task=`1eb3e8e8-1097-4731-a9ed-aa42e4441c43`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:42:29,622::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 10:42:29,623::task::595::TaskManager.Task::(_updateState) Task=`d463b78b-464a-4e13-afe2-8d23be8a4de1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:42:29,623::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:42:29,624::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c12d720d-734d-456b-ba58-d4fed4784f20`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:42:29,625::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:42:29,625::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:42:29,625::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c12d720d-734d-456b-ba58-d4fed4784f20`::Granted request
>Thread-34::DEBUG::2014-08-21 10:42:29,626::task::827::TaskManager.Task::(resourceAcquired) Task=`d463b78b-464a-4e13-afe2-8d23be8a4de1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:42:29,626::task::990::TaskManager.Task::(_decref) Task=`d463b78b-464a-4e13-afe2-8d23be8a4de1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:42:29,631::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:42:29,631::task::1185::TaskManager.Task::(prepare) Task=`d463b78b-464a-4e13-afe2-8d23be8a4de1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:42:29,631::task::595::TaskManager.Task::(_updateState) Task=`d463b78b-464a-4e13-afe2-8d23be8a4de1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:42:29,631::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:42:29,632::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:42:29,632::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:42:29,632::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:42:29,632::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:42:29,633::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:42:29,633::task::990::TaskManager.Task::(_decref) Task=`d463b78b-464a-4e13-afe2-8d23be8a4de1`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:42:29,712::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:42:29,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00059515 s, 837 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:30,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:30,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0527483 s, 19.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:32,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:32,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.207665 s, 4.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:42:34,979::task::595::TaskManager.Task::(_updateState) Task=`04775508-0820-4b6b-a8f8-ad8840356621`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:42:35,000::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Dummy-33::DEBUG::2014-08-21 10:42:35,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::INFO::2014-08-21 10:42:35,003::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059515', 'lastCheck': '5.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:42:35,016::task::1185::TaskManager.Task::(prepare) Task=`04775508-0820-4b6b-a8f8-ad8840356621`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059515', 'lastCheck': '5.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:42:35,017::task::595::TaskManager.Task::(_updateState) Task=`04775508-0820-4b6b-a8f8-ad8840356621`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:42:35,017::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:42:35,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:42:35,017::task::990::TaskManager.Task::(_decref) Task=`04775508-0820-4b6b-a8f8-ad8840356621`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:42:35,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0976482 s, 10.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:37,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:42:40,891::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-13::DEBUG::2014-08-21 10:42:40,902::task::595::TaskManager.Task::(_updateState) Task=`a944d4fd-a6a4-4dd3-bdc2-4cfe9d06ce7d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:42:40,903::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:42:40,936::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:42:40,937::task::1185::TaskManager.Task::(prepare) Task=`a944d4fd-a6a4-4dd3-bdc2-4cfe9d06ce7d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:42:40,937::task::595::TaskManager.Task::(_updateState) Task=`a944d4fd-a6a4-4dd3-bdc2-4cfe9d06ce7d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:42:40,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:42:40,938::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:42:40,938::task::990::TaskManager.Task::(_decref) Task=`a944d4fd-a6a4-4dd3-bdc2-4cfe9d06ce7d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:42:42,765::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 10:42:43,550::task::595::TaskManager.Task::(_updateState) Task=`fead0a3f-39ae-4a41-a522-78b07611d081`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:42:43,574::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:42:43,575::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f45d4161-f07d-4388-b935-05196ac1182a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:42:43,575::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:42:43,576::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:42:43,576::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f45d4161-f07d-4388-b935-05196ac1182a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:42:43,586::task::827::TaskManager.Task::(resourceAcquired) Task=`fead0a3f-39ae-4a41-a522-78b07611d081`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:42:43,587::task::990::TaskManager.Task::(_decref) Task=`fead0a3f-39ae-4a41-a522-78b07611d081`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:42:44,174::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:42:44,179::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:42:44,196::task::1185::TaskManager.Task::(prepare) Task=`fead0a3f-39ae-4a41-a522-78b07611d081`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:42:44,197::task::595::TaskManager.Task::(_updateState) Task=`fead0a3f-39ae-4a41-a522-78b07611d081`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:42:44,199::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:42:44,200::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:42:44,202::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:42:44,206::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:42:44,213::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:42:44,214::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:42:44,343::task::990::TaskManager.Task::(_decref) Task=`fead0a3f-39ae-4a41-a522-78b07611d081`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:42:44,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000635879 s, 783 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:44,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.91327 s, 148 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:46,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:54,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.02511 s, 338 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:42:54,428::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-26::DEBUG::2014-08-21 10:42:54,430::task::595::TaskManager.Task::(_updateState) Task=`c27e2da5-7e30-47a7-ae5d-6a4905d1b30e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:42:54,431::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:42:54,432::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:42:54,433::task::1185::TaskManager.Task::(prepare) Task=`c27e2da5-7e30-47a7-ae5d-6a4905d1b30e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:42:54,433::task::595::TaskManager.Task::(_updateState) Task=`c27e2da5-7e30-47a7-ae5d-6a4905d1b30e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:42:54,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:42:54,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:42:54,435::task::990::TaskManager.Task::(_decref) Task=`c27e2da5-7e30-47a7-ae5d-6a4905d1b30e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:42:54,444::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-34::DEBUG::2014-08-21 10:42:54,445::task::595::TaskManager.Task::(_updateState) Task=`2b0479c6-7e59-4e5e-b0dd-27924c21255e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:42:54,446::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:42:54,447::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`28ddca5b-81bb-4f05-b2ca-3b6062383581`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:42:54,447::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:42:54,448::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:42:54,448::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`28ddca5b-81bb-4f05-b2ca-3b6062383581`::Granted request
>Thread-34::DEBUG::2014-08-21 10:42:54,449::task::827::TaskManager.Task::(resourceAcquired) Task=`2b0479c6-7e59-4e5e-b0dd-27924c21255e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:42:54,449::task::990::TaskManager.Task::(_decref) Task=`2b0479c6-7e59-4e5e-b0dd-27924c21255e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:42:54,455::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:42:54,455::task::1185::TaskManager.Task::(prepare) Task=`2b0479c6-7e59-4e5e-b0dd-27924c21255e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:42:54,456::task::595::TaskManager.Task::(_updateState) Task=`2b0479c6-7e59-4e5e-b0dd-27924c21255e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:42:54,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:42:54,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:42:54,457::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:42:54,457::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:42:54,457::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:42:54,458::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:42:54,458::task::990::TaskManager.Task::(_decref) Task=`2b0479c6-7e59-4e5e-b0dd-27924c21255e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:42:54,564::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:42:54,583::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000473448 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:42:56,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:56,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.226439 s, 4.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:42:58,532::task::595::TaskManager.Task::(_updateState) Task=`a979dd77-8c3f-4079-afd0-b2559cd0e319`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:42:58,538::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:42:58,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473448', 'lastCheck': '4.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:42:58,600::task::1185::TaskManager.Task::(prepare) Task=`a979dd77-8c3f-4079-afd0-b2559cd0e319`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473448', 'lastCheck': '4.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:42:58,600::task::595::TaskManager.Task::(_updateState) Task=`a979dd77-8c3f-4079-afd0-b2559cd0e319`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:42:58,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:42:58,601::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:42:58,602::task::990::TaskManager.Task::(_decref) Task=`a979dd77-8c3f-4079-afd0-b2559cd0e319`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:42:58,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:42:59,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.628019 s, 1.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:01,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:01,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0663803 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:03,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:04,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457793 s, 22.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:43:04,483::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-26::DEBUG::2014-08-21 10:43:04,487::task::595::TaskManager.Task::(_updateState) Task=`3b4e9f7f-992c-409f-a8ed-1aa417996846`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:43:04,488::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:43:04,489::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:04,490::task::1185::TaskManager.Task::(prepare) Task=`3b4e9f7f-992c-409f-a8ed-1aa417996846`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:04,490::task::595::TaskManager.Task::(_updateState) Task=`3b4e9f7f-992c-409f-a8ed-1aa417996846`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:43:04,490::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:43:04,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:43:04,492::task::990::TaskManager.Task::(_decref) Task=`3b4e9f7f-992c-409f-a8ed-1aa417996846`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:43:04,512::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 10:43:04,521::task::595::TaskManager.Task::(_updateState) Task=`11823465-af1a-440e-913b-3f7888acb054`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:43:04,522::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:43:04,523::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d32e0cd9-12e6-4b7a-b3d5-73d23bbefc4f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:43:04,523::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:43:04,524::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:43:04,524::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d32e0cd9-12e6-4b7a-b3d5-73d23bbefc4f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:43:04,525::task::827::TaskManager.Task::(resourceAcquired) Task=`11823465-af1a-440e-913b-3f7888acb054`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:43:04,525::task::990::TaskManager.Task::(_decref) Task=`11823465-af1a-440e-913b-3f7888acb054`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:43:05,629::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:05,630::task::1185::TaskManager.Task::(prepare) Task=`11823465-af1a-440e-913b-3f7888acb054`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:05,631::task::595::TaskManager.Task::(_updateState) Task=`11823465-af1a-440e-913b-3f7888acb054`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:43:05,638::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:43:05,639::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:43:05,678::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:43:05,695::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:43:05,696::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:43:05,697::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:43:05,703::task::990::TaskManager.Task::(_decref) Task=`11823465-af1a-440e-913b-3f7888acb054`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:43:07,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:43:07,493::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:43:07,641::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00191299 s, 260 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:07,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.283321 s, 3.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:09,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:10,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0654124 s, 15.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:12,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:12,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107576 s, 9.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:14,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:14,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0781063 s, 13.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:16,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:16,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580461 s, 17.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:43:17,512::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-26::DEBUG::2014-08-21 10:43:17,513::task::595::TaskManager.Task::(_updateState) Task=`1679dc5a-ca19-4e48-b7db-ded4650acce7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:43:17,513::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:43:17,514::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:17,514::task::1185::TaskManager.Task::(prepare) Task=`1679dc5a-ca19-4e48-b7db-ded4650acce7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:17,515::task::595::TaskManager.Task::(_updateState) Task=`1679dc5a-ca19-4e48-b7db-ded4650acce7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:43:17,515::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:43:17,515::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:43:17,516::task::990::TaskManager.Task::(_decref) Task=`1679dc5a-ca19-4e48-b7db-ded4650acce7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:43:17,521::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 10:43:17,522::task::595::TaskManager.Task::(_updateState) Task=`ae89d174-fac0-40fb-b669-0bae6d896363`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:43:17,523::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:43:17,523::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2558def9-38e4-442c-8f2f-40101a5f353b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:43:17,524::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:43:17,524::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:43:17,524::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2558def9-38e4-442c-8f2f-40101a5f353b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:43:17,527::task::827::TaskManager.Task::(resourceAcquired) Task=`ae89d174-fac0-40fb-b669-0bae6d896363`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:43:17,527::task::990::TaskManager.Task::(_decref) Task=`ae89d174-fac0-40fb-b669-0bae6d896363`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:43:17,534::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:17,535::task::1185::TaskManager.Task::(prepare) Task=`ae89d174-fac0-40fb-b669-0bae6d896363`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:17,535::task::595::TaskManager.Task::(_updateState) Task=`ae89d174-fac0-40fb-b669-0bae6d896363`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:43:17,536::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:43:17,536::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:43:17,537::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:43:17,537::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:43:17,538::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:43:17,538::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:43:17,538::task::990::TaskManager.Task::(_decref) Task=`ae89d174-fac0-40fb-b669-0bae6d896363`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:43:17,630::task::595::TaskManager.Task::(_updateState) Task=`c25bfc33-fa0f-4c9a-a5b3-eb7279613f56`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:43:17,631::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:43:17,632::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00191299', 'lastCheck': '9.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:43:17,632::task::1185::TaskManager.Task::(prepare) Task=`c25bfc33-fa0f-4c9a-a5b3-eb7279613f56`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00191299', 'lastCheck': '9.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:43:17,632::task::595::TaskManager.Task::(_updateState) Task=`c25bfc33-fa0f-4c9a-a5b3-eb7279613f56`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:43:17,633::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:43:17,633::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:43:17,633::task::990::TaskManager.Task::(_decref) Task=`c25bfc33-fa0f-4c9a-a5b3-eb7279613f56`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:43:17,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:43:17,772::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00191971 s, 259 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:18,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:19,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0543837 s, 18.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:21,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:21,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457964 s, 22.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:23,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:23,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0509078 s, 20.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:25,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:25,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0732698 s, 14.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:43:27,567::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-26::DEBUG::2014-08-21 10:43:27,569::task::595::TaskManager.Task::(_updateState) Task=`7f37cb0a-942f-4db8-a430-457c32109385`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:43:27,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:43:27,570::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:27,571::task::1185::TaskManager.Task::(prepare) Task=`7f37cb0a-942f-4db8-a430-457c32109385`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:27,571::task::595::TaskManager.Task::(_updateState) Task=`7f37cb0a-942f-4db8-a430-457c32109385`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:43:27,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:43:27,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:43:27,573::task::990::TaskManager.Task::(_decref) Task=`7f37cb0a-942f-4db8-a430-457c32109385`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:43:27,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:43:28,290::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 10:43:28,292::task::595::TaskManager.Task::(_updateState) Task=`e56f24f3-c035-4de4-9e49-170299e844a0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:43:28,293::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:43:28,355::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-34::DEBUG::2014-08-21 10:43:28,316::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`03fe8fd3-533b-4f5a-9327-cb7b7d1beeca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:43:29,960::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:43:29,978::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:43:30,001::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`03fe8fd3-533b-4f5a-9327-cb7b7d1beeca`::Granted request
>Thread-34::DEBUG::2014-08-21 10:43:30,007::task::827::TaskManager.Task::(resourceAcquired) Task=`e56f24f3-c035-4de4-9e49-170299e844a0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:43:30,011::task::990::TaskManager.Task::(_decref) Task=`e56f24f3-c035-4de4-9e49-170299e844a0`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:43:30,021::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:43:30,026::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:43:30,037::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:43:30,045::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:43:30,046::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:43:30,048::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-34::INFO::2014-08-21 10:43:30,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:30,120::task::1185::TaskManager.Task::(prepare) Task=`e56f24f3-c035-4de4-9e49-170299e844a0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:30,122::task::595::TaskManager.Task::(_updateState) Task=`e56f24f3-c035-4de4-9e49-170299e844a0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:43:30,125::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:43:30,128::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:43:30,135::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:43:30,140::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:43:30,141::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:43:30,149::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:43:30,163::task::990::TaskManager.Task::(_decref) Task=`e56f24f3-c035-4de4-9e49-170299e844a0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:43:30,189::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:43:30,227::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00284114 s, 175 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:30,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.15189 s, 476 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:32,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:43:33,405::task::595::TaskManager.Task::(_updateState) Task=`859a3191-8394-438d-8d7e-505466d07209`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:43:33,406::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:43:33,673::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00284114', 'lastCheck': '3.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:43:33,709::task::1185::TaskManager.Task::(prepare) Task=`859a3191-8394-438d-8d7e-505466d07209`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00284114', 'lastCheck': '3.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:43:33,713::task::595::TaskManager.Task::(_updateState) Task=`859a3191-8394-438d-8d7e-505466d07209`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:43:33,739::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:43:33,756::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:43:33,797::task::990::TaskManager.Task::(_decref) Task=`859a3191-8394-438d-8d7e-505466d07209`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:43:34,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.348198 s, 2.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:36,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:36,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.076422 s, 13.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:38,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:39,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.281271 s, 3.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:43:40,208::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [464d05c]
>Thread-26::DEBUG::2014-08-21 10:43:40,218::task::595::TaskManager.Task::(_updateState) Task=`404974a0-9d60-4b24-9188-9fa9a0d26143`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:43:40,218::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:43:40,219::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:40,219::task::1185::TaskManager.Task::(prepare) Task=`404974a0-9d60-4b24-9188-9fa9a0d26143`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:40,220::task::595::TaskManager.Task::(_updateState) Task=`404974a0-9d60-4b24-9188-9fa9a0d26143`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:43:40,232::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:43:40,233::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:43:40,233::task::990::TaskManager.Task::(_decref) Task=`404974a0-9d60-4b24-9188-9fa9a0d26143`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:43:40,599::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [464d05c]
>Thread-34::DEBUG::2014-08-21 10:43:40,600::task::595::TaskManager.Task::(_updateState) Task=`e95720b0-c79c-4015-8735-2b87b47dc3e0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:43:40,601::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:43:40,603::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3c07bb2f-3b24-47ea-a57b-dff3d54f1dfc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:43:40,604::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:43:40,604::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:43:40,605::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3c07bb2f-3b24-47ea-a57b-dff3d54f1dfc`::Granted request
>Thread-34::DEBUG::2014-08-21 10:43:40,606::task::827::TaskManager.Task::(resourceAcquired) Task=`e95720b0-c79c-4015-8735-2b87b47dc3e0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:43:40,607::task::990::TaskManager.Task::(_decref) Task=`e95720b0-c79c-4015-8735-2b87b47dc3e0`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:43:40,757::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:43:40,800::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:40,800::task::1185::TaskManager.Task::(prepare) Task=`e95720b0-c79c-4015-8735-2b87b47dc3e0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:40,801::task::595::TaskManager.Task::(_updateState) Task=`e95720b0-c79c-4015-8735-2b87b47dc3e0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:43:40,807::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:43:40,807::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:43:40,808::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:43:40,809::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:43:40,809::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:43:40,809::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:43:40,810::task::990::TaskManager.Task::(_decref) Task=`e95720b0-c79c-4015-8735-2b87b47dc3e0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:43:40,885::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00993227 s, 50.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:41,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:41,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0643098 s, 15.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:43,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:43,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.123053 s, 8.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:45,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:46,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.728343 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:48,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:48,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0868902 s, 11.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:43:49,916::task::595::TaskManager.Task::(_updateState) Task=`5db506a7-1702-4ea0-80b9-76247bee8fc4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:43:49,917::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:43:49,917::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00993227', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:43:49,917::task::1185::TaskManager.Task::(prepare) Task=`5db506a7-1702-4ea0-80b9-76247bee8fc4`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00993227', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:43:49,917::task::595::TaskManager.Task::(_updateState) Task=`5db506a7-1702-4ea0-80b9-76247bee8fc4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:43:49,918::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:43:49,918::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:43:49,918::task::990::TaskManager.Task::(_decref) Task=`5db506a7-1702-4ea0-80b9-76247bee8fc4`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:43:50,930::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-26::DEBUG::2014-08-21 10:43:51,030::task::595::TaskManager.Task::(_updateState) Task=`d713e01c-46f3-45ed-a7ed-14881d421f56`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:43:51,031::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:43:51,032::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:51,032::task::1185::TaskManager.Task::(prepare) Task=`d713e01c-46f3-45ed-a7ed-14881d421f56`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:43:51,033::task::595::TaskManager.Task::(_updateState) Task=`d713e01c-46f3-45ed-a7ed-14881d421f56`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:43:51,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:43:51,036::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:43:51,036::task::990::TaskManager.Task::(_decref) Task=`d713e01c-46f3-45ed-a7ed-14881d421f56`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:43:51,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:43:51,127::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:43:51,285::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-34::DEBUG::2014-08-21 10:43:51,286::task::595::TaskManager.Task::(_updateState) Task=`eca7fa9b-002e-4b59-a46e-1b17491ab829`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:43:51,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:43:51,288::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6d749f1a-cf21-49d3-992f-fe1a3409e246`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:43:51,290::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:43:51,302::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:43:51,303::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6d749f1a-cf21-49d3-992f-fe1a3409e246`::Granted request
>Thread-34::DEBUG::2014-08-21 10:43:51,304::task::827::TaskManager.Task::(resourceAcquired) Task=`eca7fa9b-002e-4b59-a46e-1b17491ab829`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:43:51,304::task::990::TaskManager.Task::(_decref) Task=`eca7fa9b-002e-4b59-a46e-1b17491ab829`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:43:51,628::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00100178 s, 497 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:43:51,667::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:51,929::task::1185::TaskManager.Task::(prepare) Task=`eca7fa9b-002e-4b59-a46e-1b17491ab829`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:43:51,964::task::595::TaskManager.Task::(_updateState) Task=`eca7fa9b-002e-4b59-a46e-1b17491ab829`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:43:51,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:43:52,007::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:43:52,008::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:43:52,009::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:43:52,039::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:43:52,040::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:43:52,047::task::990::TaskManager.Task::(_decref) Task=`eca7fa9b-002e-4b59-a46e-1b17491ab829`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:43:53,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.88402 s, 544 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:55,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:55,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0708527 s, 14.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:57,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:57,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0994951 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:43:59,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:43:59,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0984075 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:01,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:01,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.118481 s, 8.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:44:02,471::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-26::DEBUG::2014-08-21 10:44:02,472::task::595::TaskManager.Task::(_updateState) Task=`17957485-f0c8-4139-b7cf-254d86032fe4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:02,473::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:44:02,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:02,491::task::1185::TaskManager.Task::(prepare) Task=`17957485-f0c8-4139-b7cf-254d86032fe4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:02,491::task::595::TaskManager.Task::(_updateState) Task=`17957485-f0c8-4139-b7cf-254d86032fe4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:44:02,492::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:02,492::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:02,492::task::990::TaskManager.Task::(_decref) Task=`17957485-f0c8-4139-b7cf-254d86032fe4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:44:02,497::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-34::DEBUG::2014-08-21 10:44:02,497::task::595::TaskManager.Task::(_updateState) Task=`1680f76f-9033-4355-bdb2-d745a0431a25`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:44:02,497::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:44:02,498::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ef1bd1ad-dd06-4be0-bc1a-db9eb15ff85e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:44:02,498::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:44:02,499::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:44:02,499::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ef1bd1ad-dd06-4be0-bc1a-db9eb15ff85e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:44:02,500::task::827::TaskManager.Task::(resourceAcquired) Task=`1680f76f-9033-4355-bdb2-d745a0431a25`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:44:02,500::task::990::TaskManager.Task::(_decref) Task=`1680f76f-9033-4355-bdb2-d745a0431a25`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:44:02,504::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:02,504::task::1185::TaskManager.Task::(prepare) Task=`1680f76f-9033-4355-bdb2-d745a0431a25`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:02,504::task::595::TaskManager.Task::(_updateState) Task=`1680f76f-9033-4355-bdb2-d745a0431a25`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:44:02,504::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:44:02,505::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:44:02,505::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:44:02,505::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:44:02,505::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:44:02,505::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:44:02,506::task::990::TaskManager.Task::(_decref) Task=`1680f76f-9033-4355-bdb2-d745a0431a25`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:44:02,946::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:44:02,960::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000704149 s, 707 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:03,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:04,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564363 s, 18.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:44:05,115::task::595::TaskManager.Task::(_updateState) Task=`1464f69b-b8e1-4d1e-b0ed-a46d92d5b1b7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:05,115::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:44:05,116::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704149', 'lastCheck': '2.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:44:05,117::task::1185::TaskManager.Task::(prepare) Task=`1464f69b-b8e1-4d1e-b0ed-a46d92d5b1b7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704149', 'lastCheck': '2.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:44:05,117::task::595::TaskManager.Task::(_updateState) Task=`1464f69b-b8e1-4d1e-b0ed-a46d92d5b1b7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:44:05,117::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:05,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:05,118::task::990::TaskManager.Task::(_decref) Task=`1464f69b-b8e1-4d1e-b0ed-a46d92d5b1b7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:44:06,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:06,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.206578 s, 5.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:10,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:10,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896616 s, 11.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:12,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:44:12,673::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-26::DEBUG::2014-08-21 10:44:12,674::task::595::TaskManager.Task::(_updateState) Task=`74db1d15-c165-4cd4-8f83-f4eaa396f4a1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:12,675::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:44:12,676::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:12,676::task::1185::TaskManager.Task::(prepare) Task=`74db1d15-c165-4cd4-8f83-f4eaa396f4a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:12,677::task::595::TaskManager.Task::(_updateState) Task=`74db1d15-c165-4cd4-8f83-f4eaa396f4a1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:44:12,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:12,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:12,956::task::990::TaskManager.Task::(_decref) Task=`74db1d15-c165-4cd4-8f83-f4eaa396f4a1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:44:13,310::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-34::DEBUG::2014-08-21 10:44:13,311::task::595::TaskManager.Task::(_updateState) Task=`52e2e526-ab4a-47d9-bc62-4d2adb76fa65`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:44:13,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:44:13,313::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b3ee9303-cb45-4aad-ad84-fee9b962189f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:44:13,313::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:44:13,314::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:44:13,314::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b3ee9303-cb45-4aad-ad84-fee9b962189f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:44:13,314::task::827::TaskManager.Task::(resourceAcquired) Task=`52e2e526-ab4a-47d9-bc62-4d2adb76fa65`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-15::DEBUG::2014-08-21 10:44:13,728::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:44:14,141::task::990::TaskManager.Task::(_decref) Task=`52e2e526-ab4a-47d9-bc62-4d2adb76fa65`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:44:14,169::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0052629 s, 94.6 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:44:14,198::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:14,200::task::1185::TaskManager.Task::(prepare) Task=`52e2e526-ab4a-47d9-bc62-4d2adb76fa65`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:14,201::task::595::TaskManager.Task::(_updateState) Task=`52e2e526-ab4a-47d9-bc62-4d2adb76fa65`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:44:14,202::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:44:14,202::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:44:14,204::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:44:14,205::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:44:14,205::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:44:14,206::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:44:14,207::task::990::TaskManager.Task::(_decref) Task=`52e2e526-ab4a-47d9-bc62-4d2adb76fa65`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:44:14,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.75409 s, 584 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:16,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:16,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0546993 s, 18.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:18,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:19,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.26609 s, 809 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:44:20,324::task::595::TaskManager.Task::(_updateState) Task=`08169c16-525d-46c0-bf40-4912dbad9449`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:20,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:44:20,325::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0052629', 'lastCheck': '6.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:44:20,325::task::1185::TaskManager.Task::(prepare) Task=`08169c16-525d-46c0-bf40-4912dbad9449`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0052629', 'lastCheck': '6.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:44:20,325::task::595::TaskManager.Task::(_updateState) Task=`08169c16-525d-46c0-bf40-4912dbad9449`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:44:20,326::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:20,326::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:20,326::task::990::TaskManager.Task::(_decref) Task=`08169c16-525d-46c0-bf40-4912dbad9449`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:44:22,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:22,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0887114 s, 11.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:44:24,260::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [709eb53e]
>Thread-26::DEBUG::2014-08-21 10:44:24,261::task::595::TaskManager.Task::(_updateState) Task=`f895131f-f17d-48c3-b757-04f4f485186b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:24,262::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:44:24,263::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:24,263::task::1185::TaskManager.Task::(prepare) Task=`f895131f-f17d-48c3-b757-04f4f485186b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:24,284::task::595::TaskManager.Task::(_updateState) Task=`f895131f-f17d-48c3-b757-04f4f485186b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:44:24,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:24,296::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:24,296::task::990::TaskManager.Task::(_decref) Task=`f895131f-f17d-48c3-b757-04f4f485186b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:44:24,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:44:26,237::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [709eb53e]
>Thread-34::DEBUG::2014-08-21 10:44:26,240::task::595::TaskManager.Task::(_updateState) Task=`8e75c87c-adc3-4a99-9a96-8e04717282ca`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:44:26,243::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:44:26,255::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c17dd0b8-c819-43ae-83d1-5cd268792503`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:44:26,265::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:44:26,272::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:44:26,277::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c17dd0b8-c819-43ae-83d1-5cd268792503`::Granted request
>Thread-34::DEBUG::2014-08-21 10:44:26,285::task::827::TaskManager.Task::(resourceAcquired) Task=`8e75c87c-adc3-4a99-9a96-8e04717282ca`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:44:26,287::task::990::TaskManager.Task::(_decref) Task=`8e75c87c-adc3-4a99-9a96-8e04717282ca`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:44:26,322::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:26,323::task::1185::TaskManager.Task::(prepare) Task=`8e75c87c-adc3-4a99-9a96-8e04717282ca`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:26,325::task::595::TaskManager.Task::(_updateState) Task=`8e75c87c-adc3-4a99-9a96-8e04717282ca`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:44:26,328::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:44:26,329::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 10:44:26,330::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:44:26,342::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:44:26,345::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:44:26,347::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:44:26,348::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:44:26,351::task::990::TaskManager.Task::(_decref) Task=`8e75c87c-adc3-4a99-9a96-8e04717282ca`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:44:26,364::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00113209 s, 440 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:26,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.79641 s, 570 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:28,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:28,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505669 s, 20.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:30,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:30,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0665163 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:32,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:33,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0598702 s, 17.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:35,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:35,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100422 s, 10.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:44:35,559::task::595::TaskManager.Task::(_updateState) Task=`d765e844-0d68-4c32-b7ff-9d4f7bbc4714`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:35,560::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:44:35,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113209', 'lastCheck': '9.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:44:35,561::task::1185::TaskManager.Task::(prepare) Task=`d765e844-0d68-4c32-b7ff-9d4f7bbc4714`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113209', 'lastCheck': '9.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:44:35,561::task::595::TaskManager.Task::(_updateState) Task=`d765e844-0d68-4c32-b7ff-9d4f7bbc4714`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:44:35,561::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:35,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:35,562::task::990::TaskManager.Task::(_decref) Task=`d765e844-0d68-4c32-b7ff-9d4f7bbc4714`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:44:36,381::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-26::DEBUG::2014-08-21 10:44:36,388::task::595::TaskManager.Task::(_updateState) Task=`796d0726-bce0-4845-9856-b7444d81fec8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:36,393::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:44:36,402::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:36,406::task::1185::TaskManager.Task::(prepare) Task=`796d0726-bce0-4845-9856-b7444d81fec8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:36,410::task::595::TaskManager.Task::(_updateState) Task=`796d0726-bce0-4845-9856-b7444d81fec8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:44:36,415::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:36,416::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:36,417::task::990::TaskManager.Task::(_decref) Task=`796d0726-bce0-4845-9856-b7444d81fec8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:44:36,431::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-34::DEBUG::2014-08-21 10:44:36,437::task::595::TaskManager.Task::(_updateState) Task=`188519e3-9c57-4417-89bf-08dafe047056`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:44:36,439::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:44:36,445::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1a9a3f6f-cb02-44c4-a3a7-3522ee201287`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:44:36,447::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:44:36,449::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:44:36,450::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1a9a3f6f-cb02-44c4-a3a7-3522ee201287`::Granted request
>Thread-34::DEBUG::2014-08-21 10:44:36,456::task::827::TaskManager.Task::(resourceAcquired) Task=`188519e3-9c57-4417-89bf-08dafe047056`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:44:36,458::task::990::TaskManager.Task::(_decref) Task=`188519e3-9c57-4417-89bf-08dafe047056`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:44:36,516::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-15::DEBUG::2014-08-21 10:44:36,517::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:44:36,518::task::1185::TaskManager.Task::(prepare) Task=`188519e3-9c57-4417-89bf-08dafe047056`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:36,519::task::595::TaskManager.Task::(_updateState) Task=`188519e3-9c57-4417-89bf-08dafe047056`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:44:36,535::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:44:36,536::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:44:36,537::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:44:36,538::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:44:36,538::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:44:36,538::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:44:36,539::task::990::TaskManager.Task::(_decref) Task=`188519e3-9c57-4417-89bf-08dafe047056`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:44:36,552::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00813736 s, 61.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:37,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:37,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.136991 s, 7.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:39,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:39,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.084763 s, 12.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:41,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:42,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103543 s, 9.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:44,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:44,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561413 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:46,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:46,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0592304 s, 17.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:44:46,556::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-26::DEBUG::2014-08-21 10:44:46,557::task::595::TaskManager.Task::(_updateState) Task=`2dfb85bb-28e3-48e6-9c27-45b2e89c6d3f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:46,557::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:44:46,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:46,558::task::1185::TaskManager.Task::(prepare) Task=`2dfb85bb-28e3-48e6-9c27-45b2e89c6d3f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:46,559::task::595::TaskManager.Task::(_updateState) Task=`2dfb85bb-28e3-48e6-9c27-45b2e89c6d3f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:44:46,559::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:46,559::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:46,560::task::990::TaskManager.Task::(_decref) Task=`2dfb85bb-28e3-48e6-9c27-45b2e89c6d3f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:44:46,570::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-34::DEBUG::2014-08-21 10:44:46,574::task::595::TaskManager.Task::(_updateState) Task=`5c99f53e-6533-4579-9093-745d7f23d8dd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:44:46,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:44:46,585::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cff1abec-57aa-4c6c-b575-868fe5d3bdb8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:44:46,587::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:44:46,591::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:44:46,592::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cff1abec-57aa-4c6c-b575-868fe5d3bdb8`::Granted request
>Thread-34::DEBUG::2014-08-21 10:44:46,594::task::827::TaskManager.Task::(resourceAcquired) Task=`5c99f53e-6533-4579-9093-745d7f23d8dd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:44:46,607::task::990::TaskManager.Task::(_decref) Task=`5c99f53e-6533-4579-9093-745d7f23d8dd`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:44:46,608::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:44:46,626::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:46,627::task::1185::TaskManager.Task::(prepare) Task=`5c99f53e-6533-4579-9093-745d7f23d8dd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:46,627::task::595::TaskManager.Task::(_updateState) Task=`5c99f53e-6533-4579-9093-745d7f23d8dd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:44:46,627::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:44:46,628::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:44:46,628::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:44:46,629::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:44:46,629::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:44:46,629::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:44:46,632::task::990::TaskManager.Task::(_decref) Task=`5c99f53e-6533-4579-9093-745d7f23d8dd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:44:46,641::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00747655 s, 66.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:48,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:48,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044328 s, 23.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:50,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:44:50,706::task::595::TaskManager.Task::(_updateState) Task=`be521b5d-5a8d-4cf0-babf-f067d2d0bf12`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:50,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:44:50,712::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00747655', 'lastCheck': '4.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:44:50,715::task::1185::TaskManager.Task::(prepare) Task=`be521b5d-5a8d-4cf0-babf-f067d2d0bf12`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00747655', 'lastCheck': '4.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:44:50,716::task::595::TaskManager.Task::(_updateState) Task=`be521b5d-5a8d-4cf0-babf-f067d2d0bf12`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:44:50,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:50,718::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:50,720::task::990::TaskManager.Task::(_decref) Task=`be521b5d-5a8d-4cf0-babf-f067d2d0bf12`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:44:50,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0659887 s, 15.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:52,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:54,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.378427 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:44:56,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:44:56,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0858456 s, 11.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:44:56,659::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:44:56,680::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-26::DEBUG::2014-08-21 10:44:56,681::task::595::TaskManager.Task::(_updateState) Task=`5cd7769c-a156-4f0b-bd3e-b25525ea4638`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:44:56,683::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:44:56,689::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:56,691::task::1185::TaskManager.Task::(prepare) Task=`5cd7769c-a156-4f0b-bd3e-b25525ea4638`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:44:56,694::task::595::TaskManager.Task::(_updateState) Task=`5cd7769c-a156-4f0b-bd3e-b25525ea4638`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 10:44:56,702::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000902033 s, 552 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:44:56,702::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:44:56,726::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:44:56,727::task::990::TaskManager.Task::(_decref) Task=`5cd7769c-a156-4f0b-bd3e-b25525ea4638`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:44:56,738::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-34::DEBUG::2014-08-21 10:44:56,739::task::595::TaskManager.Task::(_updateState) Task=`8b6345a6-0fec-400d-826a-9ad340fa131a`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:44:56,739::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:44:56,740::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b20d2403-f489-425a-8387-377e663eb8e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:44:56,740::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:44:56,741::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:44:56,741::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b20d2403-f489-425a-8387-377e663eb8e8`::Granted request
>Thread-34::DEBUG::2014-08-21 10:44:56,742::task::827::TaskManager.Task::(resourceAcquired) Task=`8b6345a6-0fec-400d-826a-9ad340fa131a`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:44:56,743::task::990::TaskManager.Task::(_decref) Task=`8b6345a6-0fec-400d-826a-9ad340fa131a`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:44:56,754::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:56,755::task::1185::TaskManager.Task::(prepare) Task=`8b6345a6-0fec-400d-826a-9ad340fa131a`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:44:56,755::task::595::TaskManager.Task::(_updateState) Task=`8b6345a6-0fec-400d-826a-9ad340fa131a`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:44:56,755::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:44:56,756::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:44:56,756::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:44:56,756::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:44:56,756::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:44:56,757::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:44:56,757::task::990::TaskManager.Task::(_decref) Task=`8b6345a6-0fec-400d-826a-9ad340fa131a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:44:59,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:00,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.851444 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:02,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:02,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584837 s, 17.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:04,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:06,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.489357 s, 2.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:45:06,473::task::595::TaskManager.Task::(_updateState) Task=`50fda1b7-17c3-4bd6-bba2-81d5f453f3a1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:45:06,474::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:45:06,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902033', 'lastCheck': '9.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:45:06,516::task::1185::TaskManager.Task::(prepare) Task=`50fda1b7-17c3-4bd6-bba2-81d5f453f3a1`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902033', 'lastCheck': '9.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:45:06,544::task::595::TaskManager.Task::(_updateState) Task=`50fda1b7-17c3-4bd6-bba2-81d5f453f3a1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:45:06,552::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:45:06,552::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:45:06,552::task::990::TaskManager.Task::(_decref) Task=`50fda1b7-17c3-4bd6-bba2-81d5f453f3a1`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:45:06,769::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:45:06,782::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-26::DEBUG::2014-08-21 10:45:06,783::task::595::TaskManager.Task::(_updateState) Task=`05af047f-a91a-4fff-9b2a-59fbfaaf1dc0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:45:06,784::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:45:06,784::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:45:06,784::task::1185::TaskManager.Task::(prepare) Task=`05af047f-a91a-4fff-9b2a-59fbfaaf1dc0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:45:06,785::task::595::TaskManager.Task::(_updateState) Task=`05af047f-a91a-4fff-9b2a-59fbfaaf1dc0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:45:06,785::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:45:06,785::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:45:06,785::task::990::TaskManager.Task::(_decref) Task=`05af047f-a91a-4fff-9b2a-59fbfaaf1dc0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:45:06,824::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00490158 s, 102 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:45:06,824::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-34::DEBUG::2014-08-21 10:45:06,831::task::595::TaskManager.Task::(_updateState) Task=`0ea7ab4e-89f7-40e9-a530-44ac0efedf7b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:45:06,832::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:45:06,837::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d6725b12-dc49-4f2c-bb28-b1afa8bb2b75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:45:06,838::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:45:06,842::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:45:06,843::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d6725b12-dc49-4f2c-bb28-b1afa8bb2b75`::Granted request
>Thread-34::DEBUG::2014-08-21 10:45:06,846::task::827::TaskManager.Task::(resourceAcquired) Task=`0ea7ab4e-89f7-40e9-a530-44ac0efedf7b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:45:06,847::task::990::TaskManager.Task::(_decref) Task=`0ea7ab4e-89f7-40e9-a530-44ac0efedf7b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:45:06,851::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:06,851::task::1185::TaskManager.Task::(prepare) Task=`0ea7ab4e-89f7-40e9-a530-44ac0efedf7b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:06,851::task::595::TaskManager.Task::(_updateState) Task=`0ea7ab4e-89f7-40e9-a530-44ac0efedf7b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:45:06,851::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:45:06,852::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:45:06,852::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:45:06,852::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:45:06,852::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:45:06,853::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:45:06,853::task::990::TaskManager.Task::(_decref) Task=`0ea7ab4e-89f7-40e9-a530-44ac0efedf7b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:45:08,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:08,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.130397 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:10,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:11,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.368469 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:13,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:45:17,462::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-26::DEBUG::2014-08-21 10:45:17,516::task::595::TaskManager.Task::(_updateState) Task=`ca57cf72-2de2-4ff3-976e-9556e2378c83`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:45:17,528::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:45:17,535::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:45:17,539::task::1185::TaskManager.Task::(prepare) Task=`ca57cf72-2de2-4ff3-976e-9556e2378c83`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:45:17,545::task::595::TaskManager.Task::(_updateState) Task=`ca57cf72-2de2-4ff3-976e-9556e2378c83`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:45:17,548::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:45:17,551::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:45:17,556::task::990::TaskManager.Task::(_decref) Task=`ca57cf72-2de2-4ff3-976e-9556e2378c83`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:45:17,589::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:45:17,617::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-34::DEBUG::2014-08-21 10:45:17,627::task::595::TaskManager.Task::(_updateState) Task=`900bc17c-896d-4d2c-b6e9-cb2dc60b73c0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:45:17,632::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:45:17,639::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6cba710f-bee9-491f-aa80-cae71a5a5896`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-15::DEBUG::2014-08-21 10:45:17,640::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000642025 s, 776 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:45:17,642::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:45:17,659::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:45:17,664::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6cba710f-bee9-491f-aa80-cae71a5a5896`::Granted request
>Thread-34::DEBUG::2014-08-21 10:45:17,674::task::827::TaskManager.Task::(resourceAcquired) Task=`900bc17c-896d-4d2c-b6e9-cb2dc60b73c0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:45:17,678::task::990::TaskManager.Task::(_decref) Task=`900bc17c-896d-4d2c-b6e9-cb2dc60b73c0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:45:17,717::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:17,719::task::1185::TaskManager.Task::(prepare) Task=`900bc17c-896d-4d2c-b6e9-cb2dc60b73c0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:17,720::task::595::TaskManager.Task::(_updateState) Task=`900bc17c-896d-4d2c-b6e9-cb2dc60b73c0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:45:17,721::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:45:17,722::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:45:17,723::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:45:17,724::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:45:17,725::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:45:17,725::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:45:17,726::task::990::TaskManager.Task::(_decref) Task=`900bc17c-896d-4d2c-b6e9-cb2dc60b73c0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:45:17,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.7847 s, 574 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:19,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:45:30,320::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-13::DEBUG::2014-08-21 10:45:30,323::task::595::TaskManager.Task::(_updateState) Task=`f7e2238e-6bf8-4cc8-85da-d251bda15651`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 10:45:30,341::task::595::TaskManager.Task::(_updateState) Task=`bfe22713-d2ca-4fa7-a580-9dd67cbd8ed1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:45:30,342::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:45:30,343::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642025', 'lastCheck': '12.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:45:30,344::task::1185::TaskManager.Task::(prepare) Task=`bfe22713-d2ca-4fa7-a580-9dd67cbd8ed1`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642025', 'lastCheck': '12.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:45:30,417::task::595::TaskManager.Task::(_updateState) Task=`bfe22713-d2ca-4fa7-a580-9dd67cbd8ed1`::moving from state preparing -> state finished
>Thread-13::INFO::2014-08-21 10:45:30,448::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::DEBUG::2014-08-21 10:45:30,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::INFO::2014-08-21 10:45:30,648::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:45:30,648::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:45:30,657::task::1185::TaskManager.Task::(prepare) Task=`f7e2238e-6bf8-4cc8-85da-d251bda15651`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:45:30,665::task::595::TaskManager.Task::(_updateState) Task=`f7e2238e-6bf8-4cc8-85da-d251bda15651`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:45:30,665::task::990::TaskManager.Task::(_decref) Task=`bfe22713-d2ca-4fa7-a580-9dd67cbd8ed1`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:45:30,671::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:45:30,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:45:30,687::task::990::TaskManager.Task::(_decref) Task=`f7e2238e-6bf8-4cc8-85da-d251bda15651`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:45:30,740::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-34::DEBUG::2014-08-21 10:45:30,755::task::595::TaskManager.Task::(_updateState) Task=`041e444b-94a1-42a7-a3f9-49b11ee5f93c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:45:30,768::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:45:30,790::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`db1f0951-d357-48b2-8a6d-76521330850c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:45:30,799::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:45:30,820::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:45:30,830::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`db1f0951-d357-48b2-8a6d-76521330850c`::Granted request
>Thread-34::DEBUG::2014-08-21 10:45:30,857::task::827::TaskManager.Task::(resourceAcquired) Task=`041e444b-94a1-42a7-a3f9-49b11ee5f93c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:45:30,867::task::990::TaskManager.Task::(_decref) Task=`041e444b-94a1-42a7-a3f9-49b11ee5f93c`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:45:30,891::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:45:30,957::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000737093 s, 676 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:45:30,986::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:30,991::task::1185::TaskManager.Task::(prepare) Task=`041e444b-94a1-42a7-a3f9-49b11ee5f93c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897047040', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:30,995::task::595::TaskManager.Task::(_updateState) Task=`041e444b-94a1-42a7-a3f9-49b11ee5f93c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:45:30,998::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:45:31,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:45:31,004::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:45:31,007::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:45:31,009::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:45:31,011::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:45:31,014::task::990::TaskManager.Task::(_decref) Task=`041e444b-94a1-42a7-a3f9-49b11ee5f93c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:45:31,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 11.3567 s, 90.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:33,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:38,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0946496 s, 10.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:40,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:45:41,424::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-26::DEBUG::2014-08-21 10:45:41,444::task::595::TaskManager.Task::(_updateState) Task=`56af738c-0ea3-48a4-9d08-195aa3ba2ea2`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:45:41,453::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:45:41,469::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:45:41,469::task::1185::TaskManager.Task::(prepare) Task=`56af738c-0ea3-48a4-9d08-195aa3ba2ea2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:45:41,470::task::595::TaskManager.Task::(_updateState) Task=`56af738c-0ea3-48a4-9d08-195aa3ba2ea2`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:45:41,470::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:45:41,471::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:45:41,473::task::990::TaskManager.Task::(_decref) Task=`56af738c-0ea3-48a4-9d08-195aa3ba2ea2`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:45:41,493::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-15::DEBUG::2014-08-21 10:45:41,496::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:45:41,510::task::595::TaskManager.Task::(_updateState) Task=`25b755fe-e09c-47da-ad29-478c3ffc71d5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:45:41,525::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:45:41,542::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3f6f39aa-75c9-450a-aa0b-64d97bbb8d0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-15::DEBUG::2014-08-21 10:45:41,547::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00640227 s, 77.8 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:45:41,549::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:45:41,558::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:45:41,562::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3f6f39aa-75c9-450a-aa0b-64d97bbb8d0b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:45:41,572::task::827::TaskManager.Task::(resourceAcquired) Task=`25b755fe-e09c-47da-ad29-478c3ffc71d5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:45:41,577::task::990::TaskManager.Task::(_decref) Task=`25b755fe-e09c-47da-ad29-478c3ffc71d5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:45:41,627::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:41,629::task::1185::TaskManager.Task::(prepare) Task=`25b755fe-e09c-47da-ad29-478c3ffc71d5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:41,631::task::595::TaskManager.Task::(_updateState) Task=`25b755fe-e09c-47da-ad29-478c3ffc71d5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:45:41,633::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:45:41,635::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:45:41,640::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:45:41,643::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:45:41,646::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:45:41,648::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:45:41,652::task::990::TaskManager.Task::(_decref) Task=`25b755fe-e09c-47da-ad29-478c3ffc71d5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:45:41,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.26361 s, 810 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:43,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:44,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128901 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:46,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:46,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0777281 s, 13.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:48,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:48,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.095567 s, 10.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:45:50,937::task::595::TaskManager.Task::(_updateState) Task=`fb31d35b-4d6c-4607-8537-c578a598cfd9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:45:50,938::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:45:50,938::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00640227', 'lastCheck': '9.4', 'valid': True}}
>Dummy-33::DEBUG::2014-08-21 10:45:52,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:45:52,174::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-26::DEBUG::2014-08-21 10:45:52,177::task::1185::TaskManager.Task::(prepare) Task=`fb31d35b-4d6c-4607-8537-c578a598cfd9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00640227', 'lastCheck': '9.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:45:52,196::task::595::TaskManager.Task::(_updateState) Task=`fb31d35b-4d6c-4607-8537-c578a598cfd9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:45:52,210::task::595::TaskManager.Task::(_updateState) Task=`5fec275f-28a2-4928-af7d-22a6b33b98bc`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 10:45:52,211::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::INFO::2014-08-21 10:45:52,212::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::DEBUG::2014-08-21 10:45:52,215::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::INFO::2014-08-21 10:45:52,225::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:45:52,232::task::1185::TaskManager.Task::(prepare) Task=`5fec275f-28a2-4928-af7d-22a6b33b98bc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:45:52,233::task::990::TaskManager.Task::(_decref) Task=`fb31d35b-4d6c-4607-8537-c578a598cfd9`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:45:52,235::task::595::TaskManager.Task::(_updateState) Task=`5fec275f-28a2-4928-af7d-22a6b33b98bc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:45:52,238::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:45:52,239::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:45:52,259::task::990::TaskManager.Task::(_decref) Task=`5fec275f-28a2-4928-af7d-22a6b33b98bc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:45:52,294::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-34::DEBUG::2014-08-21 10:45:52,302::task::595::TaskManager.Task::(_updateState) Task=`56ede74e-6e36-44bc-b584-e1a060e8fbf1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:45:52,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:45:52,320::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4a11ddec-63d1-4b0a-98d7-354e9315092b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:45:52,321::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 10:45:52,323::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:45:52,331::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:45:52,332::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4a11ddec-63d1-4b0a-98d7-354e9315092b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:45:52,364::task::827::TaskManager.Task::(resourceAcquired) Task=`56ede74e-6e36-44bc-b584-e1a060e8fbf1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:45:52,369::task::990::TaskManager.Task::(_decref) Task=`56ede74e-6e36-44bc-b584-e1a060e8fbf1`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:45:52,418::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000447847 s, 1.1 MB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:45:52,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:52,471::task::1185::TaskManager.Task::(prepare) Task=`56ede74e-6e36-44bc-b584-e1a060e8fbf1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:45:52,473::task::595::TaskManager.Task::(_updateState) Task=`56ede74e-6e36-44bc-b584-e1a060e8fbf1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:45:52,477::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:45:52,480::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:45:52,484::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:45:52,487::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:45:52,489::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:45:52,491::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:45:52,495::task::990::TaskManager.Task::(_decref) Task=`56ede74e-6e36-44bc-b584-e1a060e8fbf1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:45:52,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.376322 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:54,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:54,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.174953 s, 5.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:57,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:57,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0543792 s, 18.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:45:59,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:45:59,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0571652 s, 17.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:01,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:46:03,751::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [69bf064]
>Thread-13::DEBUG::2014-08-21 10:46:03,752::task::595::TaskManager.Task::(_updateState) Task=`9dcec016-d18a-42af-8347-829675ebc29a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:46:03,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:46:03,756::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:46:03,756::task::1185::TaskManager.Task::(prepare) Task=`9dcec016-d18a-42af-8347-829675ebc29a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:46:03,757::task::595::TaskManager.Task::(_updateState) Task=`9dcec016-d18a-42af-8347-829675ebc29a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:46:03,757::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:46:03,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:46:03,758::task::990::TaskManager.Task::(_decref) Task=`9dcec016-d18a-42af-8347-829675ebc29a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:46:04,095::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [69bf064]
>Thread-34::DEBUG::2014-08-21 10:46:04,096::task::595::TaskManager.Task::(_updateState) Task=`076dc034-eaba-48bf-b531-39060dfc7445`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:46:04,097::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:46:04,098::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`70f27491-de98-4e12-97d6-08bac2c3d9ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:46:04,099::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:46:04,100::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:46:04,100::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`70f27491-de98-4e12-97d6-08bac2c3d9ec`::Granted request
>Thread-34::DEBUG::2014-08-21 10:46:04,394::task::827::TaskManager.Task::(resourceAcquired) Task=`076dc034-eaba-48bf-b531-39060dfc7445`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:46:04,394::task::990::TaskManager.Task::(_decref) Task=`076dc034-eaba-48bf-b531-39060dfc7445`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:46:04,467::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:46:04,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:04,518::task::1185::TaskManager.Task::(prepare) Task=`076dc034-eaba-48bf-b531-39060dfc7445`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:04,525::task::595::TaskManager.Task::(_updateState) Task=`076dc034-eaba-48bf-b531-39060dfc7445`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:46:04,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:46:04,536::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:46:04,544::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:46:04,551::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:46:04,554::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-15::DEBUG::2014-08-21 10:46:04,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000722209 s, 690 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:46:04,558::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:46:04,565::task::990::TaskManager.Task::(_decref) Task=`076dc034-eaba-48bf-b531-39060dfc7445`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:46:04,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.176426 s, 5.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:06,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:07,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899189 s, 11.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:46:07,539::task::595::TaskManager.Task::(_updateState) Task=`563581bb-99e3-404f-87a6-3fa277d08cb3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:46:07,540::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:46:07,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722209', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:46:07,540::task::1185::TaskManager.Task::(prepare) Task=`563581bb-99e3-404f-87a6-3fa277d08cb3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722209', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:46:07,541::task::595::TaskManager.Task::(_updateState) Task=`563581bb-99e3-404f-87a6-3fa277d08cb3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:46:07,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:46:07,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:46:07,541::task::990::TaskManager.Task::(_decref) Task=`563581bb-99e3-404f-87a6-3fa277d08cb3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:46:09,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:10,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.423046 s, 2.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:12,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:12,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.419308 s, 2.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:46:14,649::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-13::DEBUG::2014-08-21 10:46:14,651::task::595::TaskManager.Task::(_updateState) Task=`ea1389ce-4ed6-4519-9b10-b038241bba85`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:46:14,652::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:46:14,652::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:46:14,653::task::1185::TaskManager.Task::(prepare) Task=`ea1389ce-4ed6-4519-9b10-b038241bba85`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:46:14,653::task::595::TaskManager.Task::(_updateState) Task=`ea1389ce-4ed6-4519-9b10-b038241bba85`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:46:14,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:46:14,653::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:46:14,653::task::990::TaskManager.Task::(_decref) Task=`ea1389ce-4ed6-4519-9b10-b038241bba85`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:46:14,786::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-34::DEBUG::2014-08-21 10:46:14,787::task::595::TaskManager.Task::(_updateState) Task=`be1eea55-5ea9-4b3a-811f-e382bd3d3b94`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:46:14,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:46:14,790::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c16e1e7f-4516-4249-b8f0-0766195be4da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:46:14,790::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:46:14,791::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:46:14,791::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c16e1e7f-4516-4249-b8f0-0766195be4da`::Granted request
>Thread-34::DEBUG::2014-08-21 10:46:14,792::task::827::TaskManager.Task::(resourceAcquired) Task=`be1eea55-5ea9-4b3a-811f-e382bd3d3b94`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:46:14,792::task::990::TaskManager.Task::(_decref) Task=`be1eea55-5ea9-4b3a-811f-e382bd3d3b94`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:46:14,796::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:14,796::task::1185::TaskManager.Task::(prepare) Task=`be1eea55-5ea9-4b3a-811f-e382bd3d3b94`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:14,797::task::595::TaskManager.Task::(_updateState) Task=`be1eea55-5ea9-4b3a-811f-e382bd3d3b94`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:46:14,797::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:46:14,797::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:46:14,797::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:46:14,798::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:46:14,798::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:46:14,800::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:46:14,802::task::990::TaskManager.Task::(_decref) Task=`be1eea55-5ea9-4b3a-811f-e382bd3d3b94`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:46:14,832::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:14,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:46:14,919::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00520893 s, 95.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:15,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0744207 s, 13.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:17,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:17,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0481437 s, 21.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:19,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:19,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124568 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:21,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:21,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0676963 s, 15.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:46:22,697::task::595::TaskManager.Task::(_updateState) Task=`932123ea-b8dd-4865-9a74-90e4def4fe20`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:46:22,698::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:46:22,699::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00520893', 'lastCheck': '7.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:46:22,699::task::1185::TaskManager.Task::(prepare) Task=`932123ea-b8dd-4865-9a74-90e4def4fe20`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00520893', 'lastCheck': '7.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:46:22,699::task::595::TaskManager.Task::(_updateState) Task=`932123ea-b8dd-4865-9a74-90e4def4fe20`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:46:22,700::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:46:22,700::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:46:22,700::task::990::TaskManager.Task::(_decref) Task=`932123ea-b8dd-4865-9a74-90e4def4fe20`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:46:24,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:46:24,990::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-13::DEBUG::2014-08-21 10:46:25,002::task::595::TaskManager.Task::(_updateState) Task=`0c4a5fcf-678a-47c2-9909-9560256ce850`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:46:25,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:46:25,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:46:25,003::task::1185::TaskManager.Task::(prepare) Task=`0c4a5fcf-678a-47c2-9909-9560256ce850`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:46:25,004::task::595::TaskManager.Task::(_updateState) Task=`0c4a5fcf-678a-47c2-9909-9560256ce850`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:46:25,004::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:46:25,004::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:46:25,004::task::990::TaskManager.Task::(_decref) Task=`0c4a5fcf-678a-47c2-9909-9560256ce850`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:46:25,436::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1887bc0f]
>Thread-34::DEBUG::2014-08-21 10:46:25,438::task::595::TaskManager.Task::(_updateState) Task=`a59bb93e-50f4-4a24-952a-0cb362d710a4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:46:25,439::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:46:25,441::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`201b2660-4ce1-47ab-bf54-d9c7d990291b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:46:25,441::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:46:25,442::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:46:25,443::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`201b2660-4ce1-47ab-bf54-d9c7d990291b`::Granted request
>Thread-34::DEBUG::2014-08-21 10:46:25,444::task::827::TaskManager.Task::(resourceAcquired) Task=`a59bb93e-50f4-4a24-952a-0cb362d710a4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:46:25,445::task::990::TaskManager.Task::(_decref) Task=`a59bb93e-50f4-4a24-952a-0cb362d710a4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:46:25,456::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:25,457::task::1185::TaskManager.Task::(prepare) Task=`a59bb93e-50f4-4a24-952a-0cb362d710a4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:25,463::task::595::TaskManager.Task::(_updateState) Task=`a59bb93e-50f4-4a24-952a-0cb362d710a4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:46:25,513::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:46:25,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:46:25,537::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:46:25,541::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:46:25,541::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:46:25,542::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:46:25,542::task::990::TaskManager.Task::(_decref) Task=`a59bb93e-50f4-4a24-952a-0cb362d710a4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:46:28,749::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:46:29,785::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000945313 s, 527 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:46:41,298::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-26::DEBUG::2014-08-21 10:46:41,321::task::595::TaskManager.Task::(_updateState) Task=`5f57274e-d168-4ebf-9ca4-f213ed4b6e29`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:46:41,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:46:41,368::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:46:41,386::task::1185::TaskManager.Task::(prepare) Task=`5f57274e-d168-4ebf-9ca4-f213ed4b6e29`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:46:41,739::task::595::TaskManager.Task::(_updateState) Task=`5f57274e-d168-4ebf-9ca4-f213ed4b6e29`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:46:41,759::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:46:41,793::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:46:41,814::task::990::TaskManager.Task::(_decref) Task=`5f57274e-d168-4ebf-9ca4-f213ed4b6e29`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:46:42,265::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 10:46:42,266::task::595::TaskManager.Task::(_updateState) Task=`a18376bd-6026-4d87-890e-5b51884113b7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:46:42,267::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:46:42,268::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6e0d857a-e782-4a66-80a1-8a5ca598d094`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:46:42,268::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:46:42,269::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:46:42,269::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6e0d857a-e782-4a66-80a1-8a5ca598d094`::Granted request
>Thread-34::DEBUG::2014-08-21 10:46:42,270::task::827::TaskManager.Task::(resourceAcquired) Task=`a18376bd-6026-4d87-890e-5b51884113b7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:46:42,270::task::990::TaskManager.Task::(_decref) Task=`a18376bd-6026-4d87-890e-5b51884113b7`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:46:42,294::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:42,295::task::1185::TaskManager.Task::(prepare) Task=`a18376bd-6026-4d87-890e-5b51884113b7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:42,295::task::595::TaskManager.Task::(_updateState) Task=`a18376bd-6026-4d87-890e-5b51884113b7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:46:42,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:46:42,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:46:42,318::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:46:42,327::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:46:42,328::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:46:42,328::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:46:42,328::task::990::TaskManager.Task::(_decref) Task=`a18376bd-6026-4d87-890e-5b51884113b7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:46:42,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 18.1552 s, 56.4 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:46:43,369::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:46:44,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0122002 s, 40.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:45,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:45,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.177511 s, 5.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:48,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:49,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.18323 s, 865 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:46:51,524::task::595::TaskManager.Task::(_updateState) Task=`360ef51e-fd19-40e2-a621-c51924648817`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:46:51,526::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:46:51,527::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122002', 'lastCheck': '7.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:46:51,528::task::1185::TaskManager.Task::(prepare) Task=`360ef51e-fd19-40e2-a621-c51924648817`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122002', 'lastCheck': '7.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:46:51,528::task::595::TaskManager.Task::(_updateState) Task=`360ef51e-fd19-40e2-a621-c51924648817`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:46:51,529::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:46:51,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:46:51,530::task::990::TaskManager.Task::(_decref) Task=`360ef51e-fd19-40e2-a621-c51924648817`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:46:51,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:46:52,934::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-13::DEBUG::2014-08-21 10:46:52,968::task::595::TaskManager.Task::(_updateState) Task=`d7865b43-d6f8-4d1d-a8ae-4aafa3861f21`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:46:52,969::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:46:53,098::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:46:53,099::task::1185::TaskManager.Task::(prepare) Task=`d7865b43-d6f8-4d1d-a8ae-4aafa3861f21`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:46:53,100::task::595::TaskManager.Task::(_updateState) Task=`d7865b43-d6f8-4d1d-a8ae-4aafa3861f21`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:46:53,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:46:53,101::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:46:53,101::task::990::TaskManager.Task::(_decref) Task=`d7865b43-d6f8-4d1d-a8ae-4aafa3861f21`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:46:53,746::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-34::DEBUG::2014-08-21 10:46:53,747::task::595::TaskManager.Task::(_updateState) Task=`6fd846cc-710c-4f26-8201-959a6dbe0e7b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:46:53,747::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:46:53,783::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`27fd2ffe-1196-41ea-b25b-f0a5803613d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:46:53,786::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:46:53,840::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:46:53,858::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`27fd2ffe-1196-41ea-b25b-f0a5803613d4`::Granted request
>Thread-34::DEBUG::2014-08-21 10:46:53,866::task::827::TaskManager.Task::(resourceAcquired) Task=`6fd846cc-710c-4f26-8201-959a6dbe0e7b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:46:53,871::task::990::TaskManager.Task::(_decref) Task=`6fd846cc-710c-4f26-8201-959a6dbe0e7b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:46:53,970::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:53,970::task::1185::TaskManager.Task::(prepare) Task=`6fd846cc-710c-4f26-8201-959a6dbe0e7b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:46:53,970::task::595::TaskManager.Task::(_updateState) Task=`6fd846cc-710c-4f26-8201-959a6dbe0e7b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:46:53,971::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:46:53,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:46:53,972::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:46:53,972::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:46:53,972::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:46:53,972::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:46:53,973::task::990::TaskManager.Task::(_decref) Task=`6fd846cc-710c-4f26-8201-959a6dbe0e7b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:46:54,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.34347 s, 437 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:46:54,399::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:46:54,428::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000507206 s, 982 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:46:56,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:46:57,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.63837 s, 625 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:00,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:01,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.21482 s, 843 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:03,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:47:11,029::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-13::DEBUG::2014-08-21 10:47:11,031::task::595::TaskManager.Task::(_updateState) Task=`068188ca-f3a8-4d3e-a959-0692eb4e20a2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:47:11,032::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:47:11,033::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:47:11,034::task::1185::TaskManager.Task::(prepare) Task=`068188ca-f3a8-4d3e-a959-0692eb4e20a2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:47:11,034::task::595::TaskManager.Task::(_updateState) Task=`068188ca-f3a8-4d3e-a959-0692eb4e20a2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:47:11,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:47:11,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:47:11,036::task::990::TaskManager.Task::(_decref) Task=`068188ca-f3a8-4d3e-a959-0692eb4e20a2`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:47:11,728::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-34::DEBUG::2014-08-21 10:47:11,810::task::595::TaskManager.Task::(_updateState) Task=`4c105f10-4c0d-4d8e-bb13-67d0aae186f0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:47:12,684::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:47:13,961::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5d7c55b0-642b-4bf8-a5ca-9170f7ddd399`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:47:13,961::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:47:13,962::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:47:13,962::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5d7c55b0-642b-4bf8-a5ca-9170f7ddd399`::Granted request
>Thread-34::DEBUG::2014-08-21 10:47:13,963::task::827::TaskManager.Task::(resourceAcquired) Task=`4c105f10-4c0d-4d8e-bb13-67d0aae186f0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:47:13,963::task::990::TaskManager.Task::(_decref) Task=`4c105f10-4c0d-4d8e-bb13-67d0aae186f0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:47:14,162::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:47:14,163::task::1185::TaskManager.Task::(prepare) Task=`4c105f10-4c0d-4d8e-bb13-67d0aae186f0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-15::DEBUG::2014-08-21 10:47:14,284::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:47:14,301::task::595::TaskManager.Task::(_updateState) Task=`4c105f10-4c0d-4d8e-bb13-67d0aae186f0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:47:18,248::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:47:19,022::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:47:19,107::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:47:19,108::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:47:19,108::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:47:19,109::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:47:19,110::task::990::TaskManager.Task::(_decref) Task=`4c105f10-4c0d-4d8e-bb13-67d0aae186f0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:47:19,300::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0371827 s, 13.4 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:47:19,574::task::595::TaskManager.Task::(_updateState) Task=`9fa8cbc2-1296-46c0-8e97-23207ad83f83`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:47:21,521::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:47:21,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507206', 'lastCheck': '27.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:47:21,523::task::1185::TaskManager.Task::(prepare) Task=`9fa8cbc2-1296-46c0-8e97-23207ad83f83`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507206', 'lastCheck': '27.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:47:21,524::task::595::TaskManager.Task::(_updateState) Task=`9fa8cbc2-1296-46c0-8e97-23207ad83f83`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:47:21,524::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:47:21,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:47:21,525::task::990::TaskManager.Task::(_decref) Task=`9fa8cbc2-1296-46c0-8e97-23207ad83f83`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:47:25,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 21.3757 s, 47.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:27,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:27,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0737253 s, 13.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:29,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:29,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.283633 s, 3.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:47:29,702::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 10:47:29,709::task::595::TaskManager.Task::(_updateState) Task=`b9e83215-81c9-410a-b893-01a95301a84f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:47:29,712::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:47:29,715::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:47:29,717::task::1185::TaskManager.Task::(prepare) Task=`b9e83215-81c9-410a-b893-01a95301a84f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:47:29,718::task::595::TaskManager.Task::(_updateState) Task=`b9e83215-81c9-410a-b893-01a95301a84f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:47:29,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:47:29,721::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:47:29,723::task::990::TaskManager.Task::(_decref) Task=`b9e83215-81c9-410a-b893-01a95301a84f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:47:29,736::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-34::DEBUG::2014-08-21 10:47:29,738::task::595::TaskManager.Task::(_updateState) Task=`ca603356-0edd-41ba-8b16-5ad747876a38`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:47:29,740::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:47:29,744::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`26c682f5-fd6c-40cb-b59c-dbe05996a9a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:47:29,746::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:47:29,749::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:47:29,750::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`26c682f5-fd6c-40cb-b59c-dbe05996a9a2`::Granted request
>Thread-34::DEBUG::2014-08-21 10:47:29,754::task::827::TaskManager.Task::(resourceAcquired) Task=`ca603356-0edd-41ba-8b16-5ad747876a38`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:47:29,756::task::990::TaskManager.Task::(_decref) Task=`ca603356-0edd-41ba-8b16-5ad747876a38`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:47:29,785::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:47:29,786::task::1185::TaskManager.Task::(prepare) Task=`ca603356-0edd-41ba-8b16-5ad747876a38`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:47:29,787::task::595::TaskManager.Task::(_updateState) Task=`ca603356-0edd-41ba-8b16-5ad747876a38`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:47:29,789::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:47:29,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:47:29,791::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:47:29,797::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:47:29,798::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:47:29,799::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:47:29,800::task::990::TaskManager.Task::(_decref) Task=`ca603356-0edd-41ba-8b16-5ad747876a38`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:47:31,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:31,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0677727 s, 15.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:47:32,382::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:47:32,417::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000937035 s, 531 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:34,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:34,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.1648 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:36,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:36,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.1404 s, 7.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:38,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:38,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0929809 s, 11.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:47:39,879::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-13::DEBUG::2014-08-21 10:47:39,880::task::595::TaskManager.Task::(_updateState) Task=`a37f340e-78ef-4c26-90ad-b07c18637786`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:47:39,881::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:47:39,882::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:47:39,882::task::1185::TaskManager.Task::(prepare) Task=`a37f340e-78ef-4c26-90ad-b07c18637786`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:47:39,882::task::595::TaskManager.Task::(_updateState) Task=`a37f340e-78ef-4c26-90ad-b07c18637786`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:47:39,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:47:39,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:47:39,885::task::990::TaskManager.Task::(_decref) Task=`a37f340e-78ef-4c26-90ad-b07c18637786`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:47:39,890::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-34::DEBUG::2014-08-21 10:47:39,891::task::595::TaskManager.Task::(_updateState) Task=`f3ab95c9-7fa7-41b8-b831-49123e6b36cc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:47:39,892::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:47:39,893::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`447fb442-9d5b-4a20-b955-128c04072fa2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:47:39,893::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:47:39,894::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:47:39,894::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`447fb442-9d5b-4a20-b955-128c04072fa2`::Granted request
>Thread-34::DEBUG::2014-08-21 10:47:39,895::task::827::TaskManager.Task::(resourceAcquired) Task=`f3ab95c9-7fa7-41b8-b831-49123e6b36cc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:47:39,895::task::990::TaskManager.Task::(_decref) Task=`f3ab95c9-7fa7-41b8-b831-49123e6b36cc`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:47:39,904::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:47:39,904::task::1185::TaskManager.Task::(prepare) Task=`f3ab95c9-7fa7-41b8-b831-49123e6b36cc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:47:39,905::task::595::TaskManager.Task::(_updateState) Task=`f3ab95c9-7fa7-41b8-b831-49123e6b36cc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:47:39,905::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:47:39,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:47:39,906::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:47:39,906::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:47:39,907::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:47:39,907::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:47:39,907::task::990::TaskManager.Task::(_decref) Task=`f3ab95c9-7fa7-41b8-b831-49123e6b36cc`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:47:40,197::task::595::TaskManager.Task::(_updateState) Task=`67588dbb-dea8-4d6c-b9c4-5cb967fe2e5c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:47:40,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:47:40,197::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000937035', 'lastCheck': '7.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:47:40,198::task::1185::TaskManager.Task::(prepare) Task=`67588dbb-dea8-4d6c-b9c4-5cb967fe2e5c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000937035', 'lastCheck': '7.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:47:40,198::task::595::TaskManager.Task::(_updateState) Task=`67588dbb-dea8-4d6c-b9c4-5cb967fe2e5c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:47:40,198::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:47:40,198::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:47:40,199::task::990::TaskManager.Task::(_decref) Task=`67588dbb-dea8-4d6c-b9c4-5cb967fe2e5c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:47:40,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:40,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150457 s, 6.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:47:42,442::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:47:42,466::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000923739 s, 539 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:42,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:43,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.109463 s, 9.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:45,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:45,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.305206 s, 3.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:47,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:47,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047592 s, 21.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:49,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:47:49,940::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-13::DEBUG::2014-08-21 10:47:49,947::task::595::TaskManager.Task::(_updateState) Task=`e9cc2104-cf31-4c12-941b-2d10eb24ce3b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:47:49,948::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:47:49,949::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:47:49,949::task::1185::TaskManager.Task::(prepare) Task=`e9cc2104-cf31-4c12-941b-2d10eb24ce3b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:47:49,949::task::595::TaskManager.Task::(_updateState) Task=`e9cc2104-cf31-4c12-941b-2d10eb24ce3b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:47:49,956::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:47:49,957::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:47:49,957::task::990::TaskManager.Task::(_decref) Task=`e9cc2104-cf31-4c12-941b-2d10eb24ce3b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:47:50,030::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-34::DEBUG::2014-08-21 10:47:50,031::task::595::TaskManager.Task::(_updateState) Task=`f62f75eb-97e9-4fef-ae10-695670474d13`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:47:50,032::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:47:50,059::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`30ec0f63-dab8-4815-9717-7c704be959a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:47:50,060::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:47:50,060::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:47:50,083::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`30ec0f63-dab8-4815-9717-7c704be959a8`::Granted request
>Thread-34::DEBUG::2014-08-21 10:47:50,112::task::827::TaskManager.Task::(resourceAcquired) Task=`f62f75eb-97e9-4fef-ae10-695670474d13`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:47:50,112::task::990::TaskManager.Task::(_decref) Task=`f62f75eb-97e9-4fef-ae10-695670474d13`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:47:50,316::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:47:50,324::task::1185::TaskManager.Task::(prepare) Task=`f62f75eb-97e9-4fef-ae10-695670474d13`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:47:50,325::task::595::TaskManager.Task::(_updateState) Task=`f62f75eb-97e9-4fef-ae10-695670474d13`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:47:50,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:47:50,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:47:50,326::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:47:50,338::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:47:50,363::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:47:50,366::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:47:50,370::task::990::TaskManager.Task::(_decref) Task=`f62f75eb-97e9-4fef-ae10-695670474d13`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:47:53,338::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:47:53,970::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00802486 s, 62.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:54,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.1204 s, 249 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:47:56,030::task::595::TaskManager.Task::(_updateState) Task=`5e5f46cb-4eb7-4687-abc8-5db184469acc`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:47:56,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:47:56,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00802486', 'lastCheck': '2.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:47:56,031::task::1185::TaskManager.Task::(prepare) Task=`5e5f46cb-4eb7-4687-abc8-5db184469acc`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00802486', 'lastCheck': '2.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:47:56,032::task::595::TaskManager.Task::(_updateState) Task=`5e5f46cb-4eb7-4687-abc8-5db184469acc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:47:56,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:47:56,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:47:56,033::task::990::TaskManager.Task::(_decref) Task=`5e5f46cb-4eb7-4687-abc8-5db184469acc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:47:56,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:56,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0843264 s, 12.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:47:58,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:47:58,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0681692 s, 15.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:48:00,692::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-13::DEBUG::2014-08-21 10:48:00,694::task::595::TaskManager.Task::(_updateState) Task=`f855963f-6e3f-4d3e-8dd0-28b9c6348087`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:48:00,695::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:48:00,697::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:48:00,698::task::1185::TaskManager.Task::(prepare) Task=`f855963f-6e3f-4d3e-8dd0-28b9c6348087`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:48:00,698::task::595::TaskManager.Task::(_updateState) Task=`f855963f-6e3f-4d3e-8dd0-28b9c6348087`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:48:00,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:48:00,699::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:48:00,699::task::990::TaskManager.Task::(_decref) Task=`f855963f-6e3f-4d3e-8dd0-28b9c6348087`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:48:00,704::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-34::DEBUG::2014-08-21 10:48:00,705::task::595::TaskManager.Task::(_updateState) Task=`cbe7bfbc-8a11-4c57-8ec6-57ec5c05a663`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:48:00,706::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:48:00,707::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1ff5599-7923-4f88-a80a-61ab441c380e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:48:00,707::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:48:00,707::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:48:00,708::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1ff5599-7923-4f88-a80a-61ab441c380e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:48:00,708::task::827::TaskManager.Task::(resourceAcquired) Task=`cbe7bfbc-8a11-4c57-8ec6-57ec5c05a663`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:48:00,708::task::990::TaskManager.Task::(_decref) Task=`cbe7bfbc-8a11-4c57-8ec6-57ec5c05a663`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:48:00,713::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:00,713::task::1185::TaskManager.Task::(prepare) Task=`cbe7bfbc-8a11-4c57-8ec6-57ec5c05a663`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:00,714::task::595::TaskManager.Task::(_updateState) Task=`cbe7bfbc-8a11-4c57-8ec6-57ec5c05a663`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:48:00,714::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:48:00,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:48:00,715::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:48:00,715::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:48:00,715::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:48:00,716::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:48:00,716::task::990::TaskManager.Task::(_decref) Task=`cbe7bfbc-8a11-4c57-8ec6-57ec5c05a663`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:48:00,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:00,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0868999 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:02,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:03,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090997 s, 11.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:48:04,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:48:04,136::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000540461 s, 921 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:05,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:05,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0916943 s, 11.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:07,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:08,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.164323 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:10,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:48:10,780::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-13::DEBUG::2014-08-21 10:48:10,782::task::595::TaskManager.Task::(_updateState) Task=`9b5e4cf7-5ab3-4162-9412-626ed7c09f0e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:48:10,783::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:48:10,783::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:48:10,784::task::1185::TaskManager.Task::(prepare) Task=`9b5e4cf7-5ab3-4162-9412-626ed7c09f0e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:48:10,784::task::595::TaskManager.Task::(_updateState) Task=`9b5e4cf7-5ab3-4162-9412-626ed7c09f0e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:48:10,784::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:48:10,784::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:48:10,784::task::990::TaskManager.Task::(_decref) Task=`9b5e4cf7-5ab3-4162-9412-626ed7c09f0e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:48:11,028::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-34::DEBUG::2014-08-21 10:48:11,040::task::595::TaskManager.Task::(_updateState) Task=`081007a7-685d-43c5-8948-d58df59b17de`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:48:11,041::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:48:11,042::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ecc0511-ea24-424c-994d-bf74b8f8c4d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:48:11,043::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:48:11,043::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:48:11,043::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7ecc0511-ea24-424c-994d-bf74b8f8c4d9`::Granted request
>Thread-34::DEBUG::2014-08-21 10:48:11,044::task::827::TaskManager.Task::(resourceAcquired) Task=`081007a7-685d-43c5-8948-d58df59b17de`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:48:11,044::task::990::TaskManager.Task::(_decref) Task=`081007a7-685d-43c5-8948-d58df59b17de`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:48:11,071::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:11,072::task::1185::TaskManager.Task::(prepare) Task=`081007a7-685d-43c5-8948-d58df59b17de`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:11,072::task::595::TaskManager.Task::(_updateState) Task=`081007a7-685d-43c5-8948-d58df59b17de`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:48:11,072::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:48:11,072::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:48:11,073::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:48:11,073::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:48:11,073::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:48:11,074::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:48:11,074::task::990::TaskManager.Task::(_decref) Task=`081007a7-685d-43c5-8948-d58df59b17de`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:48:11,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.438673 s, 2.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:48:11,358::task::595::TaskManager.Task::(_updateState) Task=`f93b79c5-fa0f-4529-962e-6338836f56cc`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:48:11,358::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:48:11,359::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540461', 'lastCheck': '7.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:48:11,359::task::1185::TaskManager.Task::(prepare) Task=`f93b79c5-fa0f-4529-962e-6338836f56cc`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540461', 'lastCheck': '7.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:48:11,360::task::595::TaskManager.Task::(_updateState) Task=`f93b79c5-fa0f-4529-962e-6338836f56cc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:48:11,360::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:48:11,360::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:48:11,360::task::990::TaskManager.Task::(_decref) Task=`f93b79c5-fa0f-4529-962e-6338836f56cc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:48:13,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:13,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0675654 s, 15.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:48:14,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:48:14,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00159139 s, 313 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:15,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:15,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0878887 s, 11.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:17,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:17,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.151033 s, 6.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:19,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:20,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0806297 s, 12.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:48:21,092::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Thread-13::DEBUG::2014-08-21 10:48:21,094::task::595::TaskManager.Task::(_updateState) Task=`8106fd4a-2c9e-45bf-95c3-96ae970109b9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:48:21,094::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:48:21,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:48:21,097::task::1185::TaskManager.Task::(prepare) Task=`8106fd4a-2c9e-45bf-95c3-96ae970109b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:48:21,097::task::595::TaskManager.Task::(_updateState) Task=`8106fd4a-2c9e-45bf-95c3-96ae970109b9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:48:21,097::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:48:21,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:48:21,098::task::990::TaskManager.Task::(_decref) Task=`8106fd4a-2c9e-45bf-95c3-96ae970109b9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:48:21,114::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Thread-34::DEBUG::2014-08-21 10:48:21,115::task::595::TaskManager.Task::(_updateState) Task=`6f56c964-23af-4f9b-9c14-f11603a729d2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:48:21,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:48:21,117::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4ec0ee66-4da7-410b-b72a-9277a4eb9703`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:48:21,117::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:48:21,117::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:48:21,117::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4ec0ee66-4da7-410b-b72a-9277a4eb9703`::Granted request
>Thread-34::DEBUG::2014-08-21 10:48:21,118::task::827::TaskManager.Task::(resourceAcquired) Task=`6f56c964-23af-4f9b-9c14-f11603a729d2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:48:21,118::task::990::TaskManager.Task::(_decref) Task=`6f56c964-23af-4f9b-9c14-f11603a729d2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:48:21,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:21,123::task::1185::TaskManager.Task::(prepare) Task=`6f56c964-23af-4f9b-9c14-f11603a729d2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:21,123::task::595::TaskManager.Task::(_updateState) Task=`6f56c964-23af-4f9b-9c14-f11603a729d2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:48:21,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:48:21,123::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:48:21,124::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:48:21,124::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:48:21,124::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:48:21,124::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:48:21,125::task::990::TaskManager.Task::(_decref) Task=`6f56c964-23af-4f9b-9c14-f11603a729d2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:48:22,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:22,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.190064 s, 5.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:48:25,519::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:48:25,728::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00182628 s, 273 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:26,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:26,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0880629 s, 11.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:48:27,691::task::595::TaskManager.Task::(_updateState) Task=`b353433a-b575-48e7-9bf1-c2aea120a252`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:48:27,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:48:27,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182628', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:48:27,693::task::1185::TaskManager.Task::(prepare) Task=`b353433a-b575-48e7-9bf1-c2aea120a252`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182628', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:48:27,693::task::595::TaskManager.Task::(_updateState) Task=`b353433a-b575-48e7-9bf1-c2aea120a252`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:48:27,693::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:48:27,694::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:48:27,694::task::990::TaskManager.Task::(_decref) Task=`b353433a-b575-48e7-9bf1-c2aea120a252`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:48:28,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:29,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.454868 s, 2.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:48:31,151::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-13::DEBUG::2014-08-21 10:48:31,153::task::595::TaskManager.Task::(_updateState) Task=`123cb40e-3e40-4660-b27e-b6635a1dad75`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:48:31,154::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:48:31,156::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:48:31,156::task::1185::TaskManager.Task::(prepare) Task=`123cb40e-3e40-4660-b27e-b6635a1dad75`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:48:31,157::task::595::TaskManager.Task::(_updateState) Task=`123cb40e-3e40-4660-b27e-b6635a1dad75`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:48:31,157::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:48:31,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:48:31,158::task::990::TaskManager.Task::(_decref) Task=`123cb40e-3e40-4660-b27e-b6635a1dad75`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:48:31,164::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-34::DEBUG::2014-08-21 10:48:31,165::task::595::TaskManager.Task::(_updateState) Task=`1b83e8cb-dd3a-4b36-9414-e865f3ab5a7f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:48:31,165::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:48:31,166::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4c9fa3cf-4603-499e-8779-7c0c8877bbdc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:48:31,166::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:48:31,168::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:48:31,168::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4c9fa3cf-4603-499e-8779-7c0c8877bbdc`::Granted request
>Thread-34::DEBUG::2014-08-21 10:48:31,169::task::827::TaskManager.Task::(resourceAcquired) Task=`1b83e8cb-dd3a-4b36-9414-e865f3ab5a7f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:48:31,169::task::990::TaskManager.Task::(_decref) Task=`1b83e8cb-dd3a-4b36-9414-e865f3ab5a7f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:48:31,173::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:31,173::task::1185::TaskManager.Task::(prepare) Task=`1b83e8cb-dd3a-4b36-9414-e865f3ab5a7f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:31,174::task::595::TaskManager.Task::(_updateState) Task=`1b83e8cb-dd3a-4b36-9414-e865f3ab5a7f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:48:31,174::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:48:31,174::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:48:31,174::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:48:31,175::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:48:31,175::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:48:31,175::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:48:31,175::task::990::TaskManager.Task::(_decref) Task=`1b83e8cb-dd3a-4b36-9414-e865f3ab5a7f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:48:31,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:31,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124348 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:33,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:33,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.097928 s, 10.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:48:35,842::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:48:35,850::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:48:35,852::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:48:35,859::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:48:35,861::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:48:35,861::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:48:35,861::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 10:48:35,870::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:48:35,883::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00047876 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:36,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:48:46,278::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-26::DEBUG::2014-08-21 10:48:46,312::task::595::TaskManager.Task::(_updateState) Task=`00bba5fc-c2c6-43f2-a0f2-028f1c2568ba`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:48:46,347::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:48:46,384::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:48:46,402::task::1185::TaskManager.Task::(prepare) Task=`00bba5fc-c2c6-43f2-a0f2-028f1c2568ba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:48:46,421::task::595::TaskManager.Task::(_updateState) Task=`00bba5fc-c2c6-43f2-a0f2-028f1c2568ba`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:48:46,439::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:48:46,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:48:46,480::task::990::TaskManager.Task::(_decref) Task=`00bba5fc-c2c6-43f2-a0f2-028f1c2568ba`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:48:46,538::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-34::DEBUG::2014-08-21 10:48:46,545::task::595::TaskManager.Task::(_updateState) Task=`9dba3357-7f4e-43ef-ac3b-8aa0aaeec92f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:48:46,549::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:48:46,559::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`647473aa-5e7b-4097-bae5-6d302ae99f54`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:48:46,564::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:48:46,571::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:48:46,575::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`647473aa-5e7b-4097-bae5-6d302ae99f54`::Granted request
>Thread-34::DEBUG::2014-08-21 10:48:46,585::task::827::TaskManager.Task::(resourceAcquired) Task=`9dba3357-7f4e-43ef-ac3b-8aa0aaeec92f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:48:46,591::task::990::TaskManager.Task::(_decref) Task=`9dba3357-7f4e-43ef-ac3b-8aa0aaeec92f`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:48:46,600::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:48:46,683::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:46,686::task::1185::TaskManager.Task::(prepare) Task=`9dba3357-7f4e-43ef-ac3b-8aa0aaeec92f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:46,688::task::595::TaskManager.Task::(_updateState) Task=`9dba3357-7f4e-43ef-ac3b-8aa0aaeec92f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:48:46,690::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:48:46,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:48:46,696::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:48:46,699::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:48:46,700::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:48:46,702::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:48:46,706::task::990::TaskManager.Task::(_decref) Task=`9dba3357-7f4e-43ef-ac3b-8aa0aaeec92f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:48:46,727::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000644129 s, 773 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:46,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.8419 s, 94.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:48,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:49,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0633177 s, 16.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:51,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:51,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.594074 s, 1.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:48:52,298::task::595::TaskManager.Task::(_updateState) Task=`8fed17f8-e8b0-49b5-9ccf-975d4495aca4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:48:52,299::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:48:52,300::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644129', 'lastCheck': '5.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:48:52,301::task::1185::TaskManager.Task::(prepare) Task=`8fed17f8-e8b0-49b5-9ccf-975d4495aca4`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644129', 'lastCheck': '5.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:48:52,301::task::595::TaskManager.Task::(_updateState) Task=`8fed17f8-e8b0-49b5-9ccf-975d4495aca4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:48:52,301::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:48:52,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:48:52,302::task::990::TaskManager.Task::(_decref) Task=`8fed17f8-e8b0-49b5-9ccf-975d4495aca4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:48:53,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:54,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0818083 s, 12.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:56,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:48:56,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.109739 s, 9.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:48:56,839::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [255ff494]
>Thread-26::DEBUG::2014-08-21 10:48:57,920::task::595::TaskManager.Task::(_updateState) Task=`5272a8ca-3527-483e-962c-65dbf51827e6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:48:57,921::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:48:57,961::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:48:57,962::task::1185::TaskManager.Task::(prepare) Task=`5272a8ca-3527-483e-962c-65dbf51827e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:48:57,962::task::595::TaskManager.Task::(_updateState) Task=`5272a8ca-3527-483e-962c-65dbf51827e6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:48:57,963::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:48:57,963::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:48:58,710::task::990::TaskManager.Task::(_decref) Task=`5272a8ca-3527-483e-962c-65dbf51827e6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:48:58,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:48:58,828::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [255ff494]
>Thread-34::DEBUG::2014-08-21 10:48:58,829::task::595::TaskManager.Task::(_updateState) Task=`4e9d3854-9708-49e2-9c20-32bca0dbbe38`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:48:58,845::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:48:58,847::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9fef1461-e683-457d-9c7b-18818e600ebe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:48:58,847::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:48:58,848::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:48:58,849::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9fef1461-e683-457d-9c7b-18818e600ebe`::Granted request
>Thread-34::DEBUG::2014-08-21 10:48:58,859::task::827::TaskManager.Task::(resourceAcquired) Task=`4e9d3854-9708-49e2-9c20-32bca0dbbe38`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:48:58,859::task::990::TaskManager.Task::(_decref) Task=`4e9d3854-9708-49e2-9c20-32bca0dbbe38`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:48:58,865::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:58,866::task::1185::TaskManager.Task::(prepare) Task=`4e9d3854-9708-49e2-9c20-32bca0dbbe38`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:48:58,867::task::595::TaskManager.Task::(_updateState) Task=`4e9d3854-9708-49e2-9c20-32bca0dbbe38`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:48:58,867::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:48:58,867::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:48:58,882::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:48:58,883::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:48:58,883::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:48:58,884::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:48:58,884::task::990::TaskManager.Task::(_decref) Task=`4e9d3854-9708-49e2-9c20-32bca0dbbe38`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:48:59,099::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:48:59,319::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00154679 s, 322 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:48:59,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.415599 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:01,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:01,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0816672 s, 12.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:03,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:04,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.401931 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:07,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:07,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0590915 s, 17.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:49:08,306::task::595::TaskManager.Task::(_updateState) Task=`3982ac5c-b891-453d-a8f6-7a5fdcd9602e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:49:08,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:49:08,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154679', 'lastCheck': '9.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:49:08,313::task::1185::TaskManager.Task::(prepare) Task=`3982ac5c-b891-453d-a8f6-7a5fdcd9602e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154679', 'lastCheck': '9.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:49:08,313::task::595::TaskManager.Task::(_updateState) Task=`3982ac5c-b891-453d-a8f6-7a5fdcd9602e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:49:08,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:49:08,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:49:08,314::task::990::TaskManager.Task::(_decref) Task=`3982ac5c-b891-453d-a8f6-7a5fdcd9602e`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:49:08,978::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Thread-13::DEBUG::2014-08-21 10:49:08,979::task::595::TaskManager.Task::(_updateState) Task=`e0e1270e-0bda-4fdd-8252-370646fddd87`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:49:08,979::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:49:08,980::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:49:08,980::task::1185::TaskManager.Task::(prepare) Task=`e0e1270e-0bda-4fdd-8252-370646fddd87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:49:08,981::task::595::TaskManager.Task::(_updateState) Task=`e0e1270e-0bda-4fdd-8252-370646fddd87`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:49:08,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:49:08,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:49:08,982::task::990::TaskManager.Task::(_decref) Task=`e0e1270e-0bda-4fdd-8252-370646fddd87`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:49:09,063::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Thread-34::DEBUG::2014-08-21 10:49:09,075::task::595::TaskManager.Task::(_updateState) Task=`6e7afcca-5a3f-47b5-99d2-1957fc783356`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:49:09,085::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:49:09,091::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5d20046c-a5d2-43e1-8c43-b449c004120d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:49:09,094::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:49:09,095::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:49:09,097::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5d20046c-a5d2-43e1-8c43-b449c004120d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:49:09,113::task::827::TaskManager.Task::(resourceAcquired) Task=`6e7afcca-5a3f-47b5-99d2-1957fc783356`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:49:09,120::task::990::TaskManager.Task::(_decref) Task=`6e7afcca-5a3f-47b5-99d2-1957fc783356`::ref 1 aborting False
>Dummy-33::DEBUG::2014-08-21 10:49:13,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::INFO::2014-08-21 10:49:13,892::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:49:13,934::task::1185::TaskManager.Task::(prepare) Task=`6e7afcca-5a3f-47b5-99d2-1957fc783356`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:49:13,967::task::595::TaskManager.Task::(_updateState) Task=`6e7afcca-5a3f-47b5-99d2-1957fc783356`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:49:13,992::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:49:14,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 10:49:14,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:49:17,213::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:49:17,325::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:49:17,326::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:49:17,326::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-15::DEBUG::2014-08-21 10:49:17,412::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0121952 s, 40.8 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:49:17,453::task::990::TaskManager.Task::(_decref) Task=`6e7afcca-5a3f-47b5-99d2-1957fc783356`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:49:17,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.99706 s, 256 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:19,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:20,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502628 s, 20.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:22,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:22,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561259 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:24,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:25,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.687256 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:27,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:49:27,298::task::595::TaskManager.Task::(_updateState) Task=`89fd8d33-4dfe-42b7-814e-f77076a60f19`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:49:27,299::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:49:27,299::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121952', 'lastCheck': '9.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:49:27,300::task::1185::TaskManager.Task::(prepare) Task=`89fd8d33-4dfe-42b7-814e-f77076a60f19`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121952', 'lastCheck': '9.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:49:27,300::task::595::TaskManager.Task::(_updateState) Task=`89fd8d33-4dfe-42b7-814e-f77076a60f19`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:49:27,300::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:49:27,301::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:49:27,301::task::990::TaskManager.Task::(_decref) Task=`89fd8d33-4dfe-42b7-814e-f77076a60f19`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:49:27,640::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-26::DEBUG::2014-08-21 10:49:27,659::task::595::TaskManager.Task::(_updateState) Task=`6f9d0aff-c309-467a-b039-6d80382b8f4f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:49:27,660::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:49:27,661::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:49:27,662::task::1185::TaskManager.Task::(prepare) Task=`6f9d0aff-c309-467a-b039-6d80382b8f4f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:49:27,663::task::595::TaskManager.Task::(_updateState) Task=`6f9d0aff-c309-467a-b039-6d80382b8f4f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:49:27,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:49:27,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:49:27,666::task::990::TaskManager.Task::(_decref) Task=`6f9d0aff-c309-467a-b039-6d80382b8f4f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:49:27,701::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-34::DEBUG::2014-08-21 10:49:27,702::task::595::TaskManager.Task::(_updateState) Task=`d774ca05-5e1a-4dfe-b896-ef44bc2f800a`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:49:27,703::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:49:27,706::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e57ab052-1f42-43f2-b418-4acedfaf7f2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:49:27,707::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:49:27,707::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:49:27,708::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e57ab052-1f42-43f2-b418-4acedfaf7f2e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:49:27,709::task::827::TaskManager.Task::(resourceAcquired) Task=`d774ca05-5e1a-4dfe-b896-ef44bc2f800a`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:49:27,709::task::990::TaskManager.Task::(_decref) Task=`d774ca05-5e1a-4dfe-b896-ef44bc2f800a`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:49:28,275::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:49:28,286::task::1185::TaskManager.Task::(prepare) Task=`d774ca05-5e1a-4dfe-b896-ef44bc2f800a`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:49:28,298::task::595::TaskManager.Task::(_updateState) Task=`d774ca05-5e1a-4dfe-b896-ef44bc2f800a`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:49:28,304::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:49:28,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:49:28,324::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:49:28,335::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:49:28,351::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:49:28,358::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:49:28,369::task::990::TaskManager.Task::(_decref) Task=`d774ca05-5e1a-4dfe-b896-ef44bc2f800a`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:49:28,453::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:49:28,507::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000577648 s, 862 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:28,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.29764 s, 789 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:30,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:31,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0655891 s, 15.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:33,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:34,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.251915 s, 4.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:36,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:49:38,788::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [709eb53e]
>Thread-26::DEBUG::2014-08-21 10:49:38,801::task::595::TaskManager.Task::(_updateState) Task=`8c0ccaf5-da0f-4f95-b4b4-d1d56beb6a07`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:49:38,802::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:49:38,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:49:38,882::task::1185::TaskManager.Task::(prepare) Task=`8c0ccaf5-da0f-4f95-b4b4-d1d56beb6a07`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:49:38,885::task::595::TaskManager.Task::(_updateState) Task=`8c0ccaf5-da0f-4f95-b4b4-d1d56beb6a07`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:49:38,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:49:38,887::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:49:38,889::task::990::TaskManager.Task::(_decref) Task=`8c0ccaf5-da0f-4f95-b4b4-d1d56beb6a07`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:49:38,890::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:49:38,925::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [709eb53e]
>Thread-34::DEBUG::2014-08-21 10:49:38,927::task::595::TaskManager.Task::(_updateState) Task=`ef4ca3e4-c493-41ca-ae09-79bcd2d04124`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:49:38,928::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:49:38,960::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ecbbc338-5195-477b-a23b-b7f4f43803a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:49:38,968::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:49:38,978::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:49:38,991::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ecbbc338-5195-477b-a23b-b7f4f43803a8`::Granted request
>Thread-34::DEBUG::2014-08-21 10:49:39,010::task::827::TaskManager.Task::(resourceAcquired) Task=`ef4ca3e4-c493-41ca-ae09-79bcd2d04124`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:49:39,017::task::990::TaskManager.Task::(_decref) Task=`ef4ca3e4-c493-41ca-ae09-79bcd2d04124`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:49:39,021::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00357503 s, 139 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:49:39,120::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:49:39,122::task::1185::TaskManager.Task::(prepare) Task=`ef4ca3e4-c493-41ca-ae09-79bcd2d04124`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:49:39,124::task::595::TaskManager.Task::(_updateState) Task=`ef4ca3e4-c493-41ca-ae09-79bcd2d04124`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:49:39,126::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:49:39,128::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:49:39,134::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:49:39,142::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:49:39,144::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:49:39,147::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:49:39,152::task::990::TaskManager.Task::(_decref) Task=`ef4ca3e4-c493-41ca-ae09-79bcd2d04124`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:49:39,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.461965 s, 2.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:41,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:42,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.893448 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:44,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:44,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0856913 s, 11.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:49:45,615::task::595::TaskManager.Task::(_updateState) Task=`4940a3ca-e475-4974-9792-293146aa7ede`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:49:45,616::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:49:45,616::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00357503', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:49:45,616::task::1185::TaskManager.Task::(prepare) Task=`4940a3ca-e475-4974-9792-293146aa7ede`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00357503', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:49:45,617::task::595::TaskManager.Task::(_updateState) Task=`4940a3ca-e475-4974-9792-293146aa7ede`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:49:45,617::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:49:45,617::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:49:45,618::task::990::TaskManager.Task::(_decref) Task=`4940a3ca-e475-4974-9792-293146aa7ede`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:49:46,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:46,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124513 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:48,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:49:49,900::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-13::DEBUG::2014-08-21 10:49:49,902::task::595::TaskManager.Task::(_updateState) Task=`0101c3de-94ac-4de4-abd3-45864a98fe20`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:49:49,903::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:49:49,904::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:49:49,905::task::1185::TaskManager.Task::(prepare) Task=`0101c3de-94ac-4de4-abd3-45864a98fe20`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:49:49,988::task::595::TaskManager.Task::(_updateState) Task=`0101c3de-94ac-4de4-abd3-45864a98fe20`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:49:50,008::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:49:50,073::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:49:50,080::task::990::TaskManager.Task::(_decref) Task=`0101c3de-94ac-4de4-abd3-45864a98fe20`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:49:50,205::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-34::DEBUG::2014-08-21 10:49:50,208::task::595::TaskManager.Task::(_updateState) Task=`1c1e936c-a644-4479-b3b0-6f9e5be86054`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:49:50,221::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:49:50,251::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:49:50,297::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`63fa3855-3c4f-4e1b-8ebf-e4a798eb3458`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:49:50,309::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:49:50,336::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:49:50,337::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`63fa3855-3c4f-4e1b-8ebf-e4a798eb3458`::Granted request
>Thread-34::DEBUG::2014-08-21 10:49:50,338::task::827::TaskManager.Task::(resourceAcquired) Task=`1c1e936c-a644-4479-b3b0-6f9e5be86054`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:49:50,346::task::990::TaskManager.Task::(_decref) Task=`1c1e936c-a644-4479-b3b0-6f9e5be86054`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:49:50,411::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000485195 s, 1.0 MB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:49:50,476::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:49:50,480::task::1185::TaskManager.Task::(prepare) Task=`1c1e936c-a644-4479-b3b0-6f9e5be86054`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:49:50,483::task::595::TaskManager.Task::(_updateState) Task=`1c1e936c-a644-4479-b3b0-6f9e5be86054`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:49:50,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:49:50,490::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:49:50,494::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:49:50,497::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:49:50,500::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:49:50,502::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:49:50,506::task::990::TaskManager.Task::(_decref) Task=`1c1e936c-a644-4479-b3b0-6f9e5be86054`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:49:50,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.8242 s, 561 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:52,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:49:52,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0569424 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:49:54,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:50:02,976::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5382417d]
>Thread-13::DEBUG::2014-08-21 10:50:02,978::task::595::TaskManager.Task::(_updateState) Task=`27ca9417-35a1-48cd-83a0-e7a60e21f1ef`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:50:03,238::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:50:03,239::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:03,240::task::1185::TaskManager.Task::(prepare) Task=`27ca9417-35a1-48cd-83a0-e7a60e21f1ef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:03,240::task::595::TaskManager.Task::(_updateState) Task=`27ca9417-35a1-48cd-83a0-e7a60e21f1ef`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:50:03,240::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:50:03,241::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:50:03,252::task::990::TaskManager.Task::(_decref) Task=`27ca9417-35a1-48cd-83a0-e7a60e21f1ef`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:50:03,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.16613 s, 198 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:50:03,843::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5382417d]
>Thread-34::DEBUG::2014-08-21 10:50:03,861::task::595::TaskManager.Task::(_updateState) Task=`88bdc9ea-d22c-4ee2-a8b4-6b126f77e3ca`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:50:03,881::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:50:03,902::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e099d2c0-cac9-45a1-88aa-ec137b35d303`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:50:03,903::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:50:03,912::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:50:03,912::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e099d2c0-cac9-45a1-88aa-ec137b35d303`::Granted request
>Thread-34::DEBUG::2014-08-21 10:50:03,913::task::827::TaskManager.Task::(resourceAcquired) Task=`88bdc9ea-d22c-4ee2-a8b4-6b126f77e3ca`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:50:03,913::task::990::TaskManager.Task::(_decref) Task=`88bdc9ea-d22c-4ee2-a8b4-6b126f77e3ca`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:50:03,927::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:03,928::task::1185::TaskManager.Task::(prepare) Task=`88bdc9ea-d22c-4ee2-a8b4-6b126f77e3ca`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:03,928::task::595::TaskManager.Task::(_updateState) Task=`88bdc9ea-d22c-4ee2-a8b4-6b126f77e3ca`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:50:03,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:50:03,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:50:03,930::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:50:03,930::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:50:03,930::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:50:03,931::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:50:03,931::task::990::TaskManager.Task::(_decref) Task=`88bdc9ea-d22c-4ee2-a8b4-6b126f77e3ca`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:50:03,956::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:50:04,071::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00615913 s, 80.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:05,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:05,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0593099 s, 17.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:50:06,250::task::595::TaskManager.Task::(_updateState) Task=`aafa4dd2-8658-4206-8d9d-312b22f6ea48`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:50:06,251::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:50:06,252::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00615913', 'lastCheck': '2.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:50:06,253::task::1185::TaskManager.Task::(prepare) Task=`aafa4dd2-8658-4206-8d9d-312b22f6ea48`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00615913', 'lastCheck': '2.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:50:06,253::task::595::TaskManager.Task::(_updateState) Task=`aafa4dd2-8658-4206-8d9d-312b22f6ea48`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:50:06,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:50:06,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:50:06,254::task::990::TaskManager.Task::(_decref) Task=`aafa4dd2-8658-4206-8d9d-312b22f6ea48`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:50:07,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:07,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0870684 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:09,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:10,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137391 s, 7.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:12,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:12,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0699867 s, 14.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:50:14,106::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-13::DEBUG::2014-08-21 10:50:14,107::task::595::TaskManager.Task::(_updateState) Task=`0c208a8b-4119-4225-9bb3-d9b1568b1001`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:50:14,108::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:50:14,109::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:14,110::task::1185::TaskManager.Task::(prepare) Task=`0c208a8b-4119-4225-9bb3-d9b1568b1001`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:14,111::task::595::TaskManager.Task::(_updateState) Task=`0c208a8b-4119-4225-9bb3-d9b1568b1001`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:50:14,111::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:50:14,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:50:14,112::task::990::TaskManager.Task::(_decref) Task=`0c208a8b-4119-4225-9bb3-d9b1568b1001`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:50:14,127::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-34::DEBUG::2014-08-21 10:50:14,130::task::595::TaskManager.Task::(_updateState) Task=`06af9b95-a0b2-4c3e-bc84-b35dba3b98c1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:50:14,131::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:50:14,133::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b311b979-8695-46d1-986b-948925379d9d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:50:14,133::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:50:14,134::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:50:14,136::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b311b979-8695-46d1-986b-948925379d9d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:50:14,146::task::827::TaskManager.Task::(resourceAcquired) Task=`06af9b95-a0b2-4c3e-bc84-b35dba3b98c1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:50:14,146::task::990::TaskManager.Task::(_decref) Task=`06af9b95-a0b2-4c3e-bc84-b35dba3b98c1`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:50:14,159::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:50:14,251::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:14,252::task::1185::TaskManager.Task::(prepare) Task=`06af9b95-a0b2-4c3e-bc84-b35dba3b98c1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:14,254::task::595::TaskManager.Task::(_updateState) Task=`06af9b95-a0b2-4c3e-bc84-b35dba3b98c1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:50:14,255::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:50:14,255::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:50:14,364::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:50:14,366::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:50:14,366::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:50:14,367::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:50:14,367::task::990::TaskManager.Task::(_decref) Task=`06af9b95-a0b2-4c3e-bc84-b35dba3b98c1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:50:14,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:50:14,549::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00246321 s, 202 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:14,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.238918 s, 4.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:16,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:17,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0570324 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:19,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:19,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469044 s, 21.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:21,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:50:21,411::task::595::TaskManager.Task::(_updateState) Task=`be1456b6-53ea-4a74-b733-ff9af7c93cc6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:50:21,412::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:50:21,412::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00246321', 'lastCheck': '6.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:50:21,412::task::1185::TaskManager.Task::(prepare) Task=`be1456b6-53ea-4a74-b733-ff9af7c93cc6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00246321', 'lastCheck': '6.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:50:21,413::task::595::TaskManager.Task::(_updateState) Task=`be1456b6-53ea-4a74-b733-ff9af7c93cc6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:50:21,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:50:21,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:50:21,413::task::990::TaskManager.Task::(_decref) Task=`be1456b6-53ea-4a74-b733-ff9af7c93cc6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:50:21,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0845774 s, 12.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:23,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:50:24,851::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-13::DEBUG::2014-08-21 10:50:24,869::task::595::TaskManager.Task::(_updateState) Task=`bb20a79a-9b83-422f-8fee-bcd33ad4c370`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:50:24,870::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:50:24,914::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:25,134::task::1185::TaskManager.Task::(prepare) Task=`bb20a79a-9b83-422f-8fee-bcd33ad4c370`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:25,265::task::595::TaskManager.Task::(_updateState) Task=`bb20a79a-9b83-422f-8fee-bcd33ad4c370`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:50:25,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:50:25,266::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:50:25,266::task::990::TaskManager.Task::(_decref) Task=`bb20a79a-9b83-422f-8fee-bcd33ad4c370`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:50:25,672::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:50:26,117::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-34::DEBUG::2014-08-21 10:50:26,120::task::595::TaskManager.Task::(_updateState) Task=`0e763e60-9596-416f-a3b2-f5bbb8a2bb8f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:50:26,121::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:50:26,161::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`28ef4ada-123c-4a59-be7f-fe790f55e7b3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:50:26,161::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:50:26,162::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:50:26,163::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`28ef4ada-123c-4a59-be7f-fe790f55e7b3`::Granted request
>Thread-34::DEBUG::2014-08-21 10:50:26,164::task::827::TaskManager.Task::(resourceAcquired) Task=`0e763e60-9596-416f-a3b2-f5bbb8a2bb8f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:50:26,165::task::990::TaskManager.Task::(_decref) Task=`0e763e60-9596-416f-a3b2-f5bbb8a2bb8f`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:50:26,211::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0691033 s, 7.2 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:50:27,178::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:27,180::task::1185::TaskManager.Task::(prepare) Task=`0e763e60-9596-416f-a3b2-f5bbb8a2bb8f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:27,181::task::595::TaskManager.Task::(_updateState) Task=`0e763e60-9596-416f-a3b2-f5bbb8a2bb8f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:50:27,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:50:27,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:50:27,184::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:50:27,185::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:50:27,186::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:50:27,187::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:50:27,188::task::990::TaskManager.Task::(_decref) Task=`0e763e60-9596-416f-a3b2-f5bbb8a2bb8f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:50:27,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.13265 s, 327 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:29,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:30,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.144305 s, 7.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:32,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:50:37,349::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-13::DEBUG::2014-08-21 10:50:38,042::task::595::TaskManager.Task::(_updateState) Task=`b020a275-d1ff-4d8f-8e3b-b5116b7e1d12`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:50:38,085::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::DEBUG::2014-08-21 10:50:38,143::task::595::TaskManager.Task::(_updateState) Task=`b9e2387b-a377-4539-96c8-e9c4050651a0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:50:38,144::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:50:38,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0691033', 'lastCheck': '11.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:50:38,145::task::1185::TaskManager.Task::(prepare) Task=`b9e2387b-a377-4539-96c8-e9c4050651a0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0691033', 'lastCheck': '11.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:50:38,158::task::595::TaskManager.Task::(_updateState) Task=`b9e2387b-a377-4539-96c8-e9c4050651a0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:50:38,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:50:38,190::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:50:38,191::task::990::TaskManager.Task::(_decref) Task=`b9e2387b-a377-4539-96c8-e9c4050651a0`::ref 0 aborting False
>Thread-13::INFO::2014-08-21 10:50:38,215::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:38,618::task::1185::TaskManager.Task::(prepare) Task=`b020a275-d1ff-4d8f-8e3b-b5116b7e1d12`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:38,653::task::595::TaskManager.Task::(_updateState) Task=`b020a275-d1ff-4d8f-8e3b-b5116b7e1d12`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:50:38,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:50:38,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:50:38,656::task::990::TaskManager.Task::(_decref) Task=`b020a275-d1ff-4d8f-8e3b-b5116b7e1d12`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:50:40,702::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:50:40,870::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00770788 s, 64.6 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:50:40,895::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 10:50:40,897::task::595::TaskManager.Task::(_updateState) Task=`c63d39cf-8799-44fc-b928-d82aefa8e7a6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:50:40,898::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:50:40,900::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6803ef8b-8bc7-4d22-88f8-af1ec1ec77f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:50:40,901::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:50:40,931::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:50:40,932::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6803ef8b-8bc7-4d22-88f8-af1ec1ec77f4`::Granted request
>Thread-34::DEBUG::2014-08-21 10:50:40,933::task::827::TaskManager.Task::(resourceAcquired) Task=`c63d39cf-8799-44fc-b928-d82aefa8e7a6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:50:40,933::task::990::TaskManager.Task::(_decref) Task=`c63d39cf-8799-44fc-b928-d82aefa8e7a6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:50:40,985::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:40,986::task::1185::TaskManager.Task::(prepare) Task=`c63d39cf-8799-44fc-b928-d82aefa8e7a6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:40,987::task::595::TaskManager.Task::(_updateState) Task=`c63d39cf-8799-44fc-b928-d82aefa8e7a6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:50:40,995::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:50:41,002::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:50:41,017::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:50:41,032::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:50:41,033::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:50:41,033::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:50:41,038::task::990::TaskManager.Task::(_decref) Task=`c63d39cf-8799-44fc-b928-d82aefa8e7a6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:50:41,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.10032 s, 168 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:43,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:43,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0805997 s, 12.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:45,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:49,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.03974 s, 502 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:50:51,148::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b99cf57]
>Thread-13::DEBUG::2014-08-21 10:50:51,150::task::595::TaskManager.Task::(_updateState) Task=`d31012ac-69de-445f-80ac-22005044002f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:50:51,151::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:50:51,151::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:51,152::task::1185::TaskManager.Task::(prepare) Task=`d31012ac-69de-445f-80ac-22005044002f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:50:51,152::task::595::TaskManager.Task::(_updateState) Task=`d31012ac-69de-445f-80ac-22005044002f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:50:51,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:50:51,153::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:50:51,153::task::990::TaskManager.Task::(_decref) Task=`d31012ac-69de-445f-80ac-22005044002f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:50:51,163::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b99cf57]
>Thread-34::DEBUG::2014-08-21 10:50:51,164::task::595::TaskManager.Task::(_updateState) Task=`a16075ad-5425-4190-b60c-ec58935868e5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:50:51,165::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:50:51,166::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`451db79f-e735-4d72-89d0-b8fe5d1d603f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:50:51,166::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:50:51,167::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:50:51,168::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`451db79f-e735-4d72-89d0-b8fe5d1d603f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:50:51,168::task::827::TaskManager.Task::(resourceAcquired) Task=`a16075ad-5425-4190-b60c-ec58935868e5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:50:51,169::task::990::TaskManager.Task::(_decref) Task=`a16075ad-5425-4190-b60c-ec58935868e5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:50:51,174::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:51,175::task::1185::TaskManager.Task::(prepare) Task=`a16075ad-5425-4190-b60c-ec58935868e5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:50:51,175::task::595::TaskManager.Task::(_updateState) Task=`a16075ad-5425-4190-b60c-ec58935868e5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:50:51,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:50:51,176::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:50:51,177::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:50:51,177::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:50:51,177::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:50:51,182::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:50:51,182::task::990::TaskManager.Task::(_decref) Task=`a16075ad-5425-4190-b60c-ec58935868e5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:50:51,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:50:51,655::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:50:51,699::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00135849 s, 367 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:52,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.642393 s, 1.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:54,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:50:54,245::task::595::TaskManager.Task::(_updateState) Task=`a0f25df9-c3a9-4721-bf1f-e60d495482b2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:50:54,246::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:50:54,246::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00135849', 'lastCheck': '2.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:50:54,247::task::1185::TaskManager.Task::(prepare) Task=`a0f25df9-c3a9-4721-bf1f-e60d495482b2`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00135849', 'lastCheck': '2.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:50:54,247::task::595::TaskManager.Task::(_updateState) Task=`a0f25df9-c3a9-4721-bf1f-e60d495482b2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:50:54,247::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:50:54,248::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:50:54,248::task::990::TaskManager.Task::(_decref) Task=`a0f25df9-c3a9-4721-bf1f-e60d495482b2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:50:54,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0604873 s, 16.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:56,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:50:56,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0766281 s, 13.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:50:58,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:51:01,328::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 10:51:01,386::task::595::TaskManager.Task::(_updateState) Task=`39729878-722b-414c-93a0-ca32f678d6ba`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:51:01,452::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:51:01,454::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:51:01,454::task::1185::TaskManager.Task::(prepare) Task=`39729878-722b-414c-93a0-ca32f678d6ba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:51:01,455::task::595::TaskManager.Task::(_updateState) Task=`39729878-722b-414c-93a0-ca32f678d6ba`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:51:01,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:51:01,632::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:51:01,648::task::990::TaskManager.Task::(_decref) Task=`39729878-722b-414c-93a0-ca32f678d6ba`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:51:01,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.58565 s, 396 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:51:01,709::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 10:51:01,716::task::595::TaskManager.Task::(_updateState) Task=`26132596-d18f-4877-8fad-0040aa7a405e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:51:01,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:51:01,735::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d2d03468-54d2-4720-bc8a-527da7f85191`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:51:01,737::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:51:01,739::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:51:01,742::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d2d03468-54d2-4720-bc8a-527da7f85191`::Granted request
>Thread-34::DEBUG::2014-08-21 10:51:01,748::task::827::TaskManager.Task::(resourceAcquired) Task=`26132596-d18f-4877-8fad-0040aa7a405e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:51:01,753::task::990::TaskManager.Task::(_decref) Task=`26132596-d18f-4877-8fad-0040aa7a405e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:51:01,802::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:01,802::task::1185::TaskManager.Task::(prepare) Task=`26132596-d18f-4877-8fad-0040aa7a405e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:01,803::task::595::TaskManager.Task::(_updateState) Task=`26132596-d18f-4877-8fad-0040aa7a405e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:51:01,803::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:51:01,803::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:51:01,804::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:51:01,804::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:51:01,805::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:51:01,805::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:51:01,806::task::990::TaskManager.Task::(_decref) Task=`26132596-d18f-4877-8fad-0040aa7a405e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:51:02,020::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:51:02,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00107106 s, 465 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:03,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:04,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.169235 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:06,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:06,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0816718 s, 12.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:08,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:08,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107473 s, 9.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:51:09,994::task::595::TaskManager.Task::(_updateState) Task=`fe8c9b90-9aac-4864-892e-a2c455046d45`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:51:09,995::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:51:09,996::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107106', 'lastCheck': '7.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:51:09,996::task::1185::TaskManager.Task::(prepare) Task=`fe8c9b90-9aac-4864-892e-a2c455046d45`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107106', 'lastCheck': '7.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:51:09,996::task::595::TaskManager.Task::(_updateState) Task=`fe8c9b90-9aac-4864-892e-a2c455046d45`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:51:09,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:51:09,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:51:09,998::task::990::TaskManager.Task::(_decref) Task=`fe8c9b90-9aac-4864-892e-a2c455046d45`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:51:10,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:51:12,202::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-13::DEBUG::2014-08-21 10:51:12,203::task::595::TaskManager.Task::(_updateState) Task=`dc50dae7-c15a-4716-b528-6fd77ab66915`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:51:12,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:51:12,570::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:51:12,570::task::1185::TaskManager.Task::(prepare) Task=`dc50dae7-c15a-4716-b528-6fd77ab66915`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:51:12,904::task::595::TaskManager.Task::(_updateState) Task=`dc50dae7-c15a-4716-b528-6fd77ab66915`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:51:13,186::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:51:13,186::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:51:13,187::task::990::TaskManager.Task::(_decref) Task=`dc50dae7-c15a-4716-b528-6fd77ab66915`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:51:13,247::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:51:13,518::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00596812 s, 83.4 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:51:13,559::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-34::DEBUG::2014-08-21 10:51:13,560::task::595::TaskManager.Task::(_updateState) Task=`abec0662-bab5-4f2d-8174-0c2706b6a10d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:51:13,641::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:51:13,643::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3f5871d9-213e-4d64-84bb-1eb109fa8479`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:51:13,644::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:51:13,645::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:51:13,645::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3f5871d9-213e-4d64-84bb-1eb109fa8479`::Granted request
>Thread-34::DEBUG::2014-08-21 10:51:14,178::task::827::TaskManager.Task::(resourceAcquired) Task=`abec0662-bab5-4f2d-8174-0c2706b6a10d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:51:14,212::task::990::TaskManager.Task::(_decref) Task=`abec0662-bab5-4f2d-8174-0c2706b6a10d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:51:14,290::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:14,291::task::1185::TaskManager.Task::(prepare) Task=`abec0662-bab5-4f2d-8174-0c2706b6a10d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:14,292::task::595::TaskManager.Task::(_updateState) Task=`abec0662-bab5-4f2d-8174-0c2706b6a10d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:51:14,292::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:51:14,293::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:51:14,301::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:51:14,306::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:51:14,307::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:51:14,307::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:51:14,308::task::990::TaskManager.Task::(_decref) Task=`abec0662-bab5-4f2d-8174-0c2706b6a10d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:51:14,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.74915 s, 273 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:16,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:17,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.544255 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:19,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:19,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429338 s, 23.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:21,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:21,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554317 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:23,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:24,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104036 s, 9.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:51:24,234::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:51:24,263::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000778508 s, 640 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:51:24,382::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-13::DEBUG::2014-08-21 10:51:24,384::task::595::TaskManager.Task::(_updateState) Task=`7e1d36ea-1ae3-4651-b62c-225ad0b95709`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:51:24,385::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:51:24,386::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:51:24,387::task::1185::TaskManager.Task::(prepare) Task=`7e1d36ea-1ae3-4651-b62c-225ad0b95709`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:51:24,387::task::595::TaskManager.Task::(_updateState) Task=`7e1d36ea-1ae3-4651-b62c-225ad0b95709`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:51:24,388::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:51:24,388::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:51:24,388::task::990::TaskManager.Task::(_decref) Task=`7e1d36ea-1ae3-4651-b62c-225ad0b95709`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:51:24,394::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 10:51:24,395::task::595::TaskManager.Task::(_updateState) Task=`895e0ba2-e196-41a2-aad0-5f99f04c1d07`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:51:24,396::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:51:24,397::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`46fb3625-3456-4ed6-b3a7-f3d5f6434084`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:51:24,397::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:51:24,398::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:51:24,398::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`46fb3625-3456-4ed6-b3a7-f3d5f6434084`::Granted request
>Thread-34::DEBUG::2014-08-21 10:51:24,399::task::827::TaskManager.Task::(resourceAcquired) Task=`895e0ba2-e196-41a2-aad0-5f99f04c1d07`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:51:24,399::task::990::TaskManager.Task::(_decref) Task=`895e0ba2-e196-41a2-aad0-5f99f04c1d07`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:51:24,404::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:24,404::task::1185::TaskManager.Task::(prepare) Task=`895e0ba2-e196-41a2-aad0-5f99f04c1d07`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:24,405::task::595::TaskManager.Task::(_updateState) Task=`895e0ba2-e196-41a2-aad0-5f99f04c1d07`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:51:24,405::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:51:24,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:51:24,406::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:51:24,406::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:51:24,406::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:51:24,406::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:51:24,406::task::990::TaskManager.Task::(_decref) Task=`895e0ba2-e196-41a2-aad0-5f99f04c1d07`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 10:51:25,413::task::595::TaskManager.Task::(_updateState) Task=`02b67eaa-ec24-4dd9-9f55-81a8f3180198`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:51:25,413::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:51:25,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778508', 'lastCheck': '1.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:51:25,414::task::1185::TaskManager.Task::(prepare) Task=`02b67eaa-ec24-4dd9-9f55-81a8f3180198`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778508', 'lastCheck': '1.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:51:25,414::task::595::TaskManager.Task::(_updateState) Task=`02b67eaa-ec24-4dd9-9f55-81a8f3180198`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:51:25,414::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:51:25,415::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:51:25,415::task::990::TaskManager.Task::(_decref) Task=`02b67eaa-ec24-4dd9-9f55-81a8f3180198`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:51:26,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:26,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.197861 s, 5.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:28,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:51:36,853::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-13::DEBUG::2014-08-21 10:51:36,854::task::595::TaskManager.Task::(_updateState) Task=`5b29e100-be3a-49aa-8d72-6a0695f82dcd`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:51:36,855::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:51:36,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:51:36,856::task::1185::TaskManager.Task::(prepare) Task=`5b29e100-be3a-49aa-8d72-6a0695f82dcd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:51:36,856::task::595::TaskManager.Task::(_updateState) Task=`5b29e100-be3a-49aa-8d72-6a0695f82dcd`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:51:36,902::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:51:36,917::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:51:36,918::task::990::TaskManager.Task::(_decref) Task=`5b29e100-be3a-49aa-8d72-6a0695f82dcd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:51:36,979::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:51:36,990::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-34::DEBUG::2014-08-21 10:51:36,993::task::595::TaskManager.Task::(_updateState) Task=`a454989b-f282-4dae-80cb-60df90a0e91e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:51:36,994::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:51:36,995::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4493379c-53c0-4764-91c1-ecf92fd3d028`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:51:36,996::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:51:36,998::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:51:36,999::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4493379c-53c0-4764-91c1-ecf92fd3d028`::Granted request
>Thread-34::DEBUG::2014-08-21 10:51:37,007::task::827::TaskManager.Task::(resourceAcquired) Task=`a454989b-f282-4dae-80cb-60df90a0e91e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:51:37,009::task::990::TaskManager.Task::(_decref) Task=`a454989b-f282-4dae-80cb-60df90a0e91e`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:51:37,022::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00148762 s, 335 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:51:37,048::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:37,051::task::1185::TaskManager.Task::(prepare) Task=`a454989b-f282-4dae-80cb-60df90a0e91e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:37,054::task::595::TaskManager.Task::(_updateState) Task=`a454989b-f282-4dae-80cb-60df90a0e91e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:51:37,056::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:51:37,058::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:51:37,060::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:51:37,062::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:51:37,063::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:51:37,064::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:51:37,066::task::990::TaskManager.Task::(_decref) Task=`a454989b-f282-4dae-80cb-60df90a0e91e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:51:37,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.55365 s, 120 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:39,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:40,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.0862 s, 943 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:42,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:42,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.141585 s, 7.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:51:43,087::task::595::TaskManager.Task::(_updateState) Task=`c0eef835-f182-436e-a517-e2a58f90c1e0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:51:43,087::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:51:43,088::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00148762', 'lastCheck': '6.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:51:43,088::task::1185::TaskManager.Task::(prepare) Task=`c0eef835-f182-436e-a517-e2a58f90c1e0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00148762', 'lastCheck': '6.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:51:43,089::task::595::TaskManager.Task::(_updateState) Task=`c0eef835-f182-436e-a517-e2a58f90c1e0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:51:43,089::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:51:43,089::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:51:43,092::task::990::TaskManager.Task::(_decref) Task=`c0eef835-f182-436e-a517-e2a58f90c1e0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:51:44,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:45,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.229835 s, 4.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:51:47,132::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-26::DEBUG::2014-08-21 10:51:47,133::task::595::TaskManager.Task::(_updateState) Task=`bcb1bfaa-ddcf-4359-a4b6-ccd299f7aa1e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:51:47,166::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:51:47,168::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:51:47,168::task::1185::TaskManager.Task::(prepare) Task=`bcb1bfaa-ddcf-4359-a4b6-ccd299f7aa1e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:51:47,168::task::595::TaskManager.Task::(_updateState) Task=`bcb1bfaa-ddcf-4359-a4b6-ccd299f7aa1e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:51:47,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:51:47,184::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:51:47,184::task::990::TaskManager.Task::(_decref) Task=`bcb1bfaa-ddcf-4359-a4b6-ccd299f7aa1e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:51:47,460::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:51:47,612::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-34::DEBUG::2014-08-21 10:51:47,613::task::595::TaskManager.Task::(_updateState) Task=`380d25d6-d356-41b1-90cf-a3be8eb5ab25`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:51:47,621::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:51:47,765::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2eeb20c6-5e96-4475-85d4-7a704352c9c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:51:47,773::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:51:47,788::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:51:47,792::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2eeb20c6-5e96-4475-85d4-7a704352c9c5`::Granted request
>Thread-34::DEBUG::2014-08-21 10:51:47,801::task::827::TaskManager.Task::(resourceAcquired) Task=`380d25d6-d356-41b1-90cf-a3be8eb5ab25`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-15::DEBUG::2014-08-21 10:51:47,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0219267 s, 22.7 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:51:47,808::task::990::TaskManager.Task::(_decref) Task=`380d25d6-d356-41b1-90cf-a3be8eb5ab25`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:51:47,831::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:47,831::task::1185::TaskManager.Task::(prepare) Task=`380d25d6-d356-41b1-90cf-a3be8eb5ab25`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:47,833::task::595::TaskManager.Task::(_updateState) Task=`380d25d6-d356-41b1-90cf-a3be8eb5ab25`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:51:47,833::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:51:47,833::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:51:47,834::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:51:47,834::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:51:47,834::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:51:47,834::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:51:47,835::task::990::TaskManager.Task::(_decref) Task=`380d25d6-d356-41b1-90cf-a3be8eb5ab25`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:51:47,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:48,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.147526 s, 6.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:50,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:50,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.3287 s, 3.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:52,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:53,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.379148 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:55,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:55,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521872 s, 19.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:51:57,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:57,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0761349 s, 13.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:51:57,845::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:51:57,862::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00165684 s, 301 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:51:57,866::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-26::DEBUG::2014-08-21 10:51:57,867::task::595::TaskManager.Task::(_updateState) Task=`b1513050-5202-412a-b116-f7ae6925de54`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:51:57,868::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:51:57,868::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:51:57,868::task::1185::TaskManager.Task::(prepare) Task=`b1513050-5202-412a-b116-f7ae6925de54`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:51:57,869::task::595::TaskManager.Task::(_updateState) Task=`b1513050-5202-412a-b116-f7ae6925de54`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:51:57,869::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:51:57,869::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:51:57,869::task::990::TaskManager.Task::(_decref) Task=`b1513050-5202-412a-b116-f7ae6925de54`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:51:57,877::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-34::DEBUG::2014-08-21 10:51:57,878::task::595::TaskManager.Task::(_updateState) Task=`616d8fcc-863c-46b7-b39e-2a678b7f0a69`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:51:57,878::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:51:57,879::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`55f48ad2-6daa-46f6-908f-5a179e5159fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:51:57,879::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:51:57,879::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:51:57,879::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`55f48ad2-6daa-46f6-908f-5a179e5159fa`::Granted request
>Thread-34::DEBUG::2014-08-21 10:51:57,880::task::827::TaskManager.Task::(resourceAcquired) Task=`616d8fcc-863c-46b7-b39e-2a678b7f0a69`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:51:57,880::task::990::TaskManager.Task::(_decref) Task=`616d8fcc-863c-46b7-b39e-2a678b7f0a69`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:51:57,884::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:57,885::task::1185::TaskManager.Task::(prepare) Task=`616d8fcc-863c-46b7-b39e-2a678b7f0a69`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:51:57,885::task::595::TaskManager.Task::(_updateState) Task=`616d8fcc-863c-46b7-b39e-2a678b7f0a69`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:51:57,885::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:51:57,885::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:51:57,886::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:51:57,886::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:51:57,886::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:51:57,886::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:51:57,887::task::990::TaskManager.Task::(_decref) Task=`616d8fcc-863c-46b7-b39e-2a678b7f0a69`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:51:58,990::task::595::TaskManager.Task::(_updateState) Task=`26f22f8d-93c7-4462-a3d5-5a5602acac3e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:51:58,991::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:51:58,991::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00165684', 'lastCheck': '1.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:51:58,991::task::1185::TaskManager.Task::(prepare) Task=`26f22f8d-93c7-4462-a3d5-5a5602acac3e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00165684', 'lastCheck': '1.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:51:58,992::task::595::TaskManager.Task::(_updateState) Task=`26f22f8d-93c7-4462-a3d5-5a5602acac3e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:51:58,992::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:51:58,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:51:58,992::task::990::TaskManager.Task::(_decref) Task=`26f22f8d-93c7-4462-a3d5-5a5602acac3e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:51:59,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:51:59,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0769217 s, 13.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:01,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:01,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497809 s, 20.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:03,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:03,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0687315 s, 14.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:05,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:06,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.182962 s, 5.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:52:07,895::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:52:07,908::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-26::DEBUG::2014-08-21 10:52:07,911::task::595::TaskManager.Task::(_updateState) Task=`a12f1f40-41be-48d4-a851-066337588616`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:52:07,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:52:07,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:07,913::task::1185::TaskManager.Task::(prepare) Task=`a12f1f40-41be-48d4-a851-066337588616`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:07,914::task::595::TaskManager.Task::(_updateState) Task=`a12f1f40-41be-48d4-a851-066337588616`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:52:07,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:52:07,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:52:07,916::task::990::TaskManager.Task::(_decref) Task=`a12f1f40-41be-48d4-a851-066337588616`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:52:07,928::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000663655 s, 750 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:52:07,942::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 10:52:07,945::task::595::TaskManager.Task::(_updateState) Task=`0a461e75-5aa3-4f04-917f-abb1301612b5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:52:07,947::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:52:07,948::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3ce20357-24ce-4818-9b2b-1236921b2022`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:52:07,948::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:52:07,949::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:52:07,949::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3ce20357-24ce-4818-9b2b-1236921b2022`::Granted request
>Thread-34::DEBUG::2014-08-21 10:52:07,950::task::827::TaskManager.Task::(resourceAcquired) Task=`0a461e75-5aa3-4f04-917f-abb1301612b5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:52:07,950::task::990::TaskManager.Task::(_decref) Task=`0a461e75-5aa3-4f04-917f-abb1301612b5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:52:07,956::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:07,957::task::1185::TaskManager.Task::(prepare) Task=`0a461e75-5aa3-4f04-917f-abb1301612b5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:07,957::task::595::TaskManager.Task::(_updateState) Task=`0a461e75-5aa3-4f04-917f-abb1301612b5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:52:07,958::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:52:07,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:52:07,959::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:52:07,960::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:52:07,960::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:52:07,960::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:52:07,961::task::990::TaskManager.Task::(_decref) Task=`0a461e75-5aa3-4f04-917f-abb1301612b5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:52:08,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:08,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.578221 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:10,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:11,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0786015 s, 13.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:13,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:13,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869599 s, 11.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:52:14,157::task::595::TaskManager.Task::(_updateState) Task=`7c53425a-df53-4719-987c-fa02ae8f5d59`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:52:14,158::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:52:14,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663655', 'lastCheck': '6.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:52:14,159::task::1185::TaskManager.Task::(prepare) Task=`7c53425a-df53-4719-987c-fa02ae8f5d59`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663655', 'lastCheck': '6.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:52:14,160::task::595::TaskManager.Task::(_updateState) Task=`7c53425a-df53-4719-987c-fa02ae8f5d59`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:52:14,160::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:52:14,161::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:52:14,161::task::990::TaskManager.Task::(_decref) Task=`7c53425a-df53-4719-987c-fa02ae8f5d59`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:52:15,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:15,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869947 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:17,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:52:18,184::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-26::DEBUG::2014-08-21 10:52:18,186::task::595::TaskManager.Task::(_updateState) Task=`afbb3336-fc5c-43f6-882e-ce84cbdca6e2`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:52:18,187::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:52:18,188::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:18,188::task::1185::TaskManager.Task::(prepare) Task=`afbb3336-fc5c-43f6-882e-ce84cbdca6e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:18,189::task::595::TaskManager.Task::(_updateState) Task=`afbb3336-fc5c-43f6-882e-ce84cbdca6e2`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:52:18,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:52:18,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:52:18,190::task::990::TaskManager.Task::(_decref) Task=`afbb3336-fc5c-43f6-882e-ce84cbdca6e2`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:52:18,231::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-34::DEBUG::2014-08-21 10:52:18,233::task::595::TaskManager.Task::(_updateState) Task=`677d1d1a-9173-433d-8933-d33797f720c3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:52:18,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:52:18,239::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a83eb408-b347-4312-b0fd-13745108b796`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:52:18,240::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:52:18,240::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:52:18,241::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a83eb408-b347-4312-b0fd-13745108b796`::Granted request
>Thread-34::DEBUG::2014-08-21 10:52:18,243::task::827::TaskManager.Task::(resourceAcquired) Task=`677d1d1a-9173-433d-8933-d33797f720c3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:52:18,243::task::990::TaskManager.Task::(_decref) Task=`677d1d1a-9173-433d-8933-d33797f720c3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:52:18,274::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:18,275::task::1185::TaskManager.Task::(prepare) Task=`677d1d1a-9173-433d-8933-d33797f720c3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:18,275::task::595::TaskManager.Task::(_updateState) Task=`677d1d1a-9173-433d-8933-d33797f720c3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:52:18,276::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:52:18,276::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:52:18,276::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:52:18,277::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:52:18,277::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:52:18,277::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:52:18,278::task::990::TaskManager.Task::(_decref) Task=`677d1d1a-9173-433d-8933-d33797f720c3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:52:18,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:52:18,475::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0651924 s, 7.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:18,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.20006 s, 853 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:20,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:20,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0864686 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:22,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:23,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100903 s, 10.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:25,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:52:28,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-26::DEBUG::2014-08-21 10:52:28,423::task::595::TaskManager.Task::(_updateState) Task=`86e1a57b-62ea-4913-90b1-fddec12e9a1b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:52:28,424::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:52:28,424::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:28,425::task::1185::TaskManager.Task::(prepare) Task=`86e1a57b-62ea-4913-90b1-fddec12e9a1b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:28,425::task::595::TaskManager.Task::(_updateState) Task=`86e1a57b-62ea-4913-90b1-fddec12e9a1b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:52:28,425::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:52:28,426::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:52:28,426::task::990::TaskManager.Task::(_decref) Task=`86e1a57b-62ea-4913-90b1-fddec12e9a1b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:52:28,495::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-34::DEBUG::2014-08-21 10:52:28,497::task::595::TaskManager.Task::(_updateState) Task=`d198e0cb-a4a2-42d0-90e7-85b2bd12f017`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:52:28,497::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:52:28,511::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac0a9299-a3a2-43b3-bb5d-6d46e6c6476f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:52:28,512::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:52:28,513::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:52:28,538::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac0a9299-a3a2-43b3-bb5d-6d46e6c6476f`::Granted request
>Thread-34::DEBUG::2014-08-21 10:52:28,539::task::827::TaskManager.Task::(resourceAcquired) Task=`d198e0cb-a4a2-42d0-90e7-85b2bd12f017`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:52:28,547::task::990::TaskManager.Task::(_decref) Task=`d198e0cb-a4a2-42d0-90e7-85b2bd12f017`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:52:28,583::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:28,584::task::1185::TaskManager.Task::(prepare) Task=`d198e0cb-a4a2-42d0-90e7-85b2bd12f017`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:28,584::task::595::TaskManager.Task::(_updateState) Task=`d198e0cb-a4a2-42d0-90e7-85b2bd12f017`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:52:28,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:52:28,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:52:28,586::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:52:28,588::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:52:28,588::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:52:28,589::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:52:28,589::task::990::TaskManager.Task::(_decref) Task=`d198e0cb-a4a2-42d0-90e7-85b2bd12f017`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:52:28,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.37905 s, 743 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:52:28,896::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:52:28,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00100574 s, 495 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:52:31,648::task::595::TaskManager.Task::(_updateState) Task=`54507232-8819-4b77-87ba-599c252b9bba`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:52:31,649::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:52:31,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100574', 'lastCheck': '2.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:52:31,650::task::1185::TaskManager.Task::(prepare) Task=`54507232-8819-4b77-87ba-599c252b9bba`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100574', 'lastCheck': '2.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:52:31,651::task::595::TaskManager.Task::(_updateState) Task=`54507232-8819-4b77-87ba-599c252b9bba`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:52:31,651::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:52:31,652::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:52:31,652::task::990::TaskManager.Task::(_decref) Task=`54507232-8819-4b77-87ba-599c252b9bba`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:52:31,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:33,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.42088 s, 721 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:35,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:36,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.482909 s, 2.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:52:38,958::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-26::DEBUG::2014-08-21 10:52:38,980::task::595::TaskManager.Task::(_updateState) Task=`f6eee90c-b25f-4af6-9e71-4d55b58b1db9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:52:38,987::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:52:39,000::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Dummy-33::DEBUG::2014-08-21 10:52:39,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:52:39,003::task::1185::TaskManager.Task::(prepare) Task=`f6eee90c-b25f-4af6-9e71-4d55b58b1db9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:39,017::task::595::TaskManager.Task::(_updateState) Task=`f6eee90c-b25f-4af6-9e71-4d55b58b1db9`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 10:52:39,025::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:52:39,042::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:52:39,043::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:52:39,044::task::990::TaskManager.Task::(_decref) Task=`f6eee90c-b25f-4af6-9e71-4d55b58b1db9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:52:39,052::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-34::DEBUG::2014-08-21 10:52:39,053::task::595::TaskManager.Task::(_updateState) Task=`8b1c0e53-2f0e-46e4-b64d-5e8d3739d98a`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:52:39,054::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:52:39,055::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`06f8bbe0-b062-4900-a5e9-643513f63e6d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:52:39,056::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:52:39,059::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:52:39,069::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`06f8bbe0-b062-4900-a5e9-643513f63e6d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:52:39,080::task::827::TaskManager.Task::(resourceAcquired) Task=`8b1c0e53-2f0e-46e4-b64d-5e8d3739d98a`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:52:39,086::task::990::TaskManager.Task::(_decref) Task=`8b1c0e53-2f0e-46e4-b64d-5e8d3739d98a`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:52:39,092::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000591807 s, 841 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:52:39,151::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:39,153::task::1185::TaskManager.Task::(prepare) Task=`8b1c0e53-2f0e-46e4-b64d-5e8d3739d98a`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:39,154::task::595::TaskManager.Task::(_updateState) Task=`8b1c0e53-2f0e-46e4-b64d-5e8d3739d98a`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:52:39,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:52:39,155::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:52:39,161::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:52:39,162::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:52:39,163::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:52:39,164::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:52:39,166::task::990::TaskManager.Task::(_decref) Task=`8b1c0e53-2f0e-46e4-b64d-5e8d3739d98a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:52:39,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.18315 s, 5.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:41,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:41,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0677845 s, 15.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:43,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:44,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.709254 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:46,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:46,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175194 s, 5.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:52:47,231::task::595::TaskManager.Task::(_updateState) Task=`21e971e8-7835-4105-8586-1f0128c7687d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:52:47,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:52:47,233::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591807', 'lastCheck': '8.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:52:47,233::task::1185::TaskManager.Task::(prepare) Task=`21e971e8-7835-4105-8586-1f0128c7687d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591807', 'lastCheck': '8.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:52:47,234::task::595::TaskManager.Task::(_updateState) Task=`21e971e8-7835-4105-8586-1f0128c7687d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:52:47,235::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:52:47,236::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:52:47,237::task::990::TaskManager.Task::(_decref) Task=`21e971e8-7835-4105-8586-1f0128c7687d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:52:48,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:52:49,247::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [cac2746]
>Thread-26::DEBUG::2014-08-21 10:52:49,248::task::595::TaskManager.Task::(_updateState) Task=`1bf35942-7c18-43e8-bd67-cd28573b3245`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:52:49,249::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:52:49,250::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:49,250::task::1185::TaskManager.Task::(prepare) Task=`1bf35942-7c18-43e8-bd67-cd28573b3245`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:49,250::task::595::TaskManager.Task::(_updateState) Task=`1bf35942-7c18-43e8-bd67-cd28573b3245`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:52:49,250::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:52:49,251::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:52:49,251::task::990::TaskManager.Task::(_decref) Task=`1bf35942-7c18-43e8-bd67-cd28573b3245`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:52:49,455::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [cac2746]
>Thread-34::DEBUG::2014-08-21 10:52:49,456::task::595::TaskManager.Task::(_updateState) Task=`ebb4fd00-edfa-4b01-9c49-68f53e3725af`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:52:49,457::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:52:49,460::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`978e9107-403b-49e2-a7a7-77c405f0cab6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:52:49,460::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:52:49,461::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:52:49,461::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`978e9107-403b-49e2-a7a7-77c405f0cab6`::Granted request
>Thread-34::DEBUG::2014-08-21 10:52:49,462::task::827::TaskManager.Task::(resourceAcquired) Task=`ebb4fd00-edfa-4b01-9c49-68f53e3725af`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:52:49,462::task::990::TaskManager.Task::(_decref) Task=`ebb4fd00-edfa-4b01-9c49-68f53e3725af`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:52:49,468::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:49,469::task::1185::TaskManager.Task::(prepare) Task=`ebb4fd00-edfa-4b01-9c49-68f53e3725af`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:52:49,469::task::595::TaskManager.Task::(_updateState) Task=`ebb4fd00-edfa-4b01-9c49-68f53e3725af`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:52:49,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:52:49,470::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:52:49,470::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:52:49,470::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:52:49,471::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:52:49,471::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:52:49,472::task::990::TaskManager.Task::(_decref) Task=`ebb4fd00-edfa-4b01-9c49-68f53e3725af`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:52:49,493::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:52:49,769::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0232503 s, 21.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:50,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.07012 s, 957 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:52,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:52,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467285 s, 21.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:54,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:54,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0633448 s, 16.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:56,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:52:56,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0567427 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:52:58,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:52:59,902::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-26::DEBUG::2014-08-21 10:52:59,904::task::595::TaskManager.Task::(_updateState) Task=`1322f8f0-f802-4d14-a5b9-731db61d0375`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:52:59,904::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:52:59,906::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:59,907::task::1185::TaskManager.Task::(prepare) Task=`1322f8f0-f802-4d14-a5b9-731db61d0375`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:52:59,907::task::595::TaskManager.Task::(_updateState) Task=`1322f8f0-f802-4d14-a5b9-731db61d0375`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:52:59,908::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:52:59,908::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:52:59,909::task::990::TaskManager.Task::(_decref) Task=`1322f8f0-f802-4d14-a5b9-731db61d0375`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:52:59,965::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-34::DEBUG::2014-08-21 10:52:59,966::task::595::TaskManager.Task::(_updateState) Task=`43cb1672-d2dd-4843-907d-0272d788ad48`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:52:59,992::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:53:00,054::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2d709b6b-730d-416b-b11e-0ca288121952`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:53:00,056::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:53:00,058::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:53:00,059::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2d709b6b-730d-416b-b11e-0ca288121952`::Granted request
>Thread-34::DEBUG::2014-08-21 10:53:00,125::task::827::TaskManager.Task::(resourceAcquired) Task=`43cb1672-d2dd-4843-907d-0272d788ad48`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:53:00,140::task::990::TaskManager.Task::(_decref) Task=`43cb1672-d2dd-4843-907d-0272d788ad48`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:53:01,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:01,363::task::1185::TaskManager.Task::(prepare) Task=`43cb1672-d2dd-4843-907d-0272d788ad48`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:01,364::task::595::TaskManager.Task::(_updateState) Task=`43cb1672-d2dd-4843-907d-0272d788ad48`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:53:01,365::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:53:01,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:53:01,511::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-15::DEBUG::2014-08-21 10:53:01,819::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:53:01,828::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:53:01,835::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:53:01,996::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:53:01,998::task::990::TaskManager.Task::(_decref) Task=`43cb1672-d2dd-4843-907d-0272d788ad48`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:53:02,308::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0125137 s, 39.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:02,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.338199 s, 3.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:53:03,330::task::595::TaskManager.Task::(_updateState) Task=`b99c6097-fce3-46c7-b37e-1ea6da540ab0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:53:03,331::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:53:03,332::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0125137', 'lastCheck': '0.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:53:03,333::task::1185::TaskManager.Task::(prepare) Task=`b99c6097-fce3-46c7-b37e-1ea6da540ab0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0125137', 'lastCheck': '0.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:53:03,333::task::595::TaskManager.Task::(_updateState) Task=`b99c6097-fce3-46c7-b37e-1ea6da540ab0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:53:03,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:53:03,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:53:03,335::task::990::TaskManager.Task::(_decref) Task=`b99c6097-fce3-46c7-b37e-1ea6da540ab0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:53:05,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:06,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.445729 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:08,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:08,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.117108 s, 8.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:10,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:10,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.31486 s, 3.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:53:12,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-26::DEBUG::2014-08-21 10:53:12,356::task::595::TaskManager.Task::(_updateState) Task=`19e98c7e-0886-4a2e-983a-e9e2ca35c418`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:53:12,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:53:12,357::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:53:12,358::task::1185::TaskManager.Task::(prepare) Task=`19e98c7e-0886-4a2e-983a-e9e2ca35c418`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:53:12,358::task::595::TaskManager.Task::(_updateState) Task=`19e98c7e-0886-4a2e-983a-e9e2ca35c418`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:53:12,358::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:53:12,359::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:53:12,359::task::990::TaskManager.Task::(_decref) Task=`19e98c7e-0886-4a2e-983a-e9e2ca35c418`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:53:12,365::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-34::DEBUG::2014-08-21 10:53:12,367::task::595::TaskManager.Task::(_updateState) Task=`ea9d0173-9ab6-4c50-9d12-888acca28e9c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:53:12,367::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:53:12,368::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fd71d579-636c-483c-84b6-ac2f8d74d320`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:53:12,370::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:53:12,371::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:53:12,371::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fd71d579-636c-483c-84b6-ac2f8d74d320`::Granted request
>Thread-34::DEBUG::2014-08-21 10:53:12,372::task::827::TaskManager.Task::(resourceAcquired) Task=`ea9d0173-9ab6-4c50-9d12-888acca28e9c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:53:12,372::task::990::TaskManager.Task::(_decref) Task=`ea9d0173-9ab6-4c50-9d12-888acca28e9c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:53:12,379::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:12,379::task::1185::TaskManager.Task::(prepare) Task=`ea9d0173-9ab6-4c50-9d12-888acca28e9c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:12,380::task::595::TaskManager.Task::(_updateState) Task=`ea9d0173-9ab6-4c50-9d12-888acca28e9c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:53:12,380::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:53:12,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:53:12,381::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:53:12,382::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:53:12,382::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:53:12,383::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:53:12,384::task::990::TaskManager.Task::(_decref) Task=`ea9d0173-9ab6-4c50-9d12-888acca28e9c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:53:12,528::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:53:12,551::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00316103 s, 158 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:13,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:13,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0857322 s, 11.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:15,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:15,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.257978 s, 4.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:17,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:18,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.135389 s, 7.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:53:19,675::task::595::TaskManager.Task::(_updateState) Task=`16fe07bc-e665-4d2c-8de2-1a01d87558ea`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:53:19,676::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:53:19,676::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00316103', 'lastCheck': '7.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:53:19,677::task::1185::TaskManager.Task::(prepare) Task=`16fe07bc-e665-4d2c-8de2-1a01d87558ea`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00316103', 'lastCheck': '7.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:53:19,677::task::595::TaskManager.Task::(_updateState) Task=`16fe07bc-e665-4d2c-8de2-1a01d87558ea`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:53:19,677::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:53:19,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:53:19,678::task::990::TaskManager.Task::(_decref) Task=`16fe07bc-e665-4d2c-8de2-1a01d87558ea`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:53:20,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:20,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110022 s, 9.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:53:22,430::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-26::DEBUG::2014-08-21 10:53:22,436::task::595::TaskManager.Task::(_updateState) Task=`e9b8305c-1ed6-4913-9c82-9ed3a9658b8f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:53:22,438::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:53:22,439::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:53:22,439::task::1185::TaskManager.Task::(prepare) Task=`e9b8305c-1ed6-4913-9c82-9ed3a9658b8f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:53:22,439::task::595::TaskManager.Task::(_updateState) Task=`e9b8305c-1ed6-4913-9c82-9ed3a9658b8f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:53:22,444::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:53:22,444::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:53:22,444::task::990::TaskManager.Task::(_decref) Task=`e9b8305c-1ed6-4913-9c82-9ed3a9658b8f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:53:22,571::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Dummy-33::DEBUG::2014-08-21 10:53:22,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:53:22,622::task::595::TaskManager.Task::(_updateState) Task=`a79ea0d1-6055-4691-a005-162e913d8176`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 10:53:22,833::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:53:22,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:53:22,946::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ae17d14b-51e5-451e-ad67-36266e610060`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:53:22,946::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:53:22,947::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:53:22,947::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ae17d14b-51e5-451e-ad67-36266e610060`::Granted request
>Thread-34::DEBUG::2014-08-21 10:53:22,995::task::827::TaskManager.Task::(resourceAcquired) Task=`a79ea0d1-6055-4691-a005-162e913d8176`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:53:23,098::task::990::TaskManager.Task::(_decref) Task=`a79ea0d1-6055-4691-a005-162e913d8176`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:53:23,164::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0163264 s, 30.5 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:53:24,027::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:24,034::task::1185::TaskManager.Task::(prepare) Task=`a79ea0d1-6055-4691-a005-162e913d8176`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:24,038::task::595::TaskManager.Task::(_updateState) Task=`a79ea0d1-6055-4691-a005-162e913d8176`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:53:24,042::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:53:24,047::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:53:24,050::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:53:24,051::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:53:24,052::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:53:24,053::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:53:24,055::task::990::TaskManager.Task::(_decref) Task=`a79ea0d1-6055-4691-a005-162e913d8176`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:53:24,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.364 s, 751 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:26,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:26,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124741 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:28,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:29,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.08974 s, 940 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:31,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:31,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0556055 s, 18.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:33,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:53:35,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-15::DEBUG::2014-08-21 10:53:35,087::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:53:35,189::task::595::TaskManager.Task::(_updateState) Task=`881b92df-e0d8-4fc6-9d8e-09eca64313cc`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:53:35,215::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:53:35,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-15::DEBUG::2014-08-21 10:53:35,276::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00256656 s, 194 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:53:35,319::task::1185::TaskManager.Task::(prepare) Task=`881b92df-e0d8-4fc6-9d8e-09eca64313cc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:53:35,514::task::595::TaskManager.Task::(_updateState) Task=`881b92df-e0d8-4fc6-9d8e-09eca64313cc`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:53:35,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:53:35,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:53:35,611::task::990::TaskManager.Task::(_decref) Task=`881b92df-e0d8-4fc6-9d8e-09eca64313cc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:53:35,718::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-34::DEBUG::2014-08-21 10:53:35,726::task::595::TaskManager.Task::(_updateState) Task=`9b83ebed-df2d-4548-b2bf-b34008fb827c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:53:35,728::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:53:35,732::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`75541038-5749-4f00-98d6-9d4797147c46`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:53:35,733::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:53:35,735::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:53:35,736::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`75541038-5749-4f00-98d6-9d4797147c46`::Granted request
>Thread-34::DEBUG::2014-08-21 10:53:35,739::task::827::TaskManager.Task::(resourceAcquired) Task=`9b83ebed-df2d-4548-b2bf-b34008fb827c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:53:35,740::task::990::TaskManager.Task::(_decref) Task=`9b83ebed-df2d-4548-b2bf-b34008fb827c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:53:35,770::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:35,771::task::1185::TaskManager.Task::(prepare) Task=`9b83ebed-df2d-4548-b2bf-b34008fb827c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:35,773::task::595::TaskManager.Task::(_updateState) Task=`9b83ebed-df2d-4548-b2bf-b34008fb827c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:53:35,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:53:35,776::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:53:35,778::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:53:35,780::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:53:35,782::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:53:35,783::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:53:35,785::task::990::TaskManager.Task::(_decref) Task=`9b83ebed-df2d-4548-b2bf-b34008fb827c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:53:36,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.04153 s, 502 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:53:36,072::task::595::TaskManager.Task::(_updateState) Task=`d08ccd94-102d-4beb-8ed7-11c465f90493`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:53:36,072::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:53:36,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00256656', 'lastCheck': '0.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:53:36,073::task::1185::TaskManager.Task::(prepare) Task=`d08ccd94-102d-4beb-8ed7-11c465f90493`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00256656', 'lastCheck': '0.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:53:36,073::task::595::TaskManager.Task::(_updateState) Task=`d08ccd94-102d-4beb-8ed7-11c465f90493`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:53:36,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:53:36,073::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:53:36,073::task::990::TaskManager.Task::(_decref) Task=`d08ccd94-102d-4beb-8ed7-11c465f90493`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:53:38,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:38,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479462 s, 21.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:40,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:40,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469956 s, 21.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:42,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:42,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0652668 s, 15.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:44,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:44,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0622198 s, 16.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:53:45,725::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:53:45,735::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:53:45,745::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:53:45,768::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:53:45,780::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:53:45,780::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:53:45,780::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 10:53:45,794::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:53:45,812::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [cac2746]
>Thread-26::DEBUG::2014-08-21 10:53:45,813::task::595::TaskManager.Task::(_updateState) Task=`1af798d5-19c9-4194-beb2-ba1345b83a9f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:53:45,814::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:53:45,814::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:53:45,815::task::1185::TaskManager.Task::(prepare) Task=`1af798d5-19c9-4194-beb2-ba1345b83a9f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:53:45,815::task::595::TaskManager.Task::(_updateState) Task=`1af798d5-19c9-4194-beb2-ba1345b83a9f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:53:45,815::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:53:45,815::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:53:45,816::task::990::TaskManager.Task::(_decref) Task=`1af798d5-19c9-4194-beb2-ba1345b83a9f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:53:45,822::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00739347 s, 67.4 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:53:45,824::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [cac2746]
>Thread-34::DEBUG::2014-08-21 10:53:45,824::task::595::TaskManager.Task::(_updateState) Task=`7094ac28-46e4-4dd8-bb56-22da025a1692`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:53:45,825::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:53:45,826::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f15b15f5-7d80-4056-803a-e4a66fd070f7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:53:45,826::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:53:45,826::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:53:45,827::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f15b15f5-7d80-4056-803a-e4a66fd070f7`::Granted request
>Thread-34::DEBUG::2014-08-21 10:53:45,827::task::827::TaskManager.Task::(resourceAcquired) Task=`7094ac28-46e4-4dd8-bb56-22da025a1692`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:53:45,828::task::990::TaskManager.Task::(_decref) Task=`7094ac28-46e4-4dd8-bb56-22da025a1692`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:53:45,844::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:45,845::task::1185::TaskManager.Task::(prepare) Task=`7094ac28-46e4-4dd8-bb56-22da025a1692`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:45,845::task::595::TaskManager.Task::(_updateState) Task=`7094ac28-46e4-4dd8-bb56-22da025a1692`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:53:45,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:53:45,845::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:53:45,846::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:53:45,846::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:53:45,846::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:53:45,846::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:53:45,847::task::990::TaskManager.Task::(_decref) Task=`7094ac28-46e4-4dd8-bb56-22da025a1692`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:53:47,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:49,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.68833 s, 381 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:51,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:51,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0685668 s, 14.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:53:52,635::task::595::TaskManager.Task::(_updateState) Task=`c3d3128f-8760-482c-a485-467ea0258db9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:53:52,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:53:52,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00739347', 'lastCheck': '6.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:53:52,640::task::1185::TaskManager.Task::(prepare) Task=`c3d3128f-8760-482c-a485-467ea0258db9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00739347', 'lastCheck': '6.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:53:52,641::task::595::TaskManager.Task::(_updateState) Task=`c3d3128f-8760-482c-a485-467ea0258db9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:53:52,641::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:53:52,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:53:52,641::task::990::TaskManager.Task::(_decref) Task=`c3d3128f-8760-482c-a485-467ea0258db9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:53:54,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:54,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.190366 s, 5.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:53:55,892::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-26::DEBUG::2014-08-21 10:53:55,894::task::595::TaskManager.Task::(_updateState) Task=`7af75b3a-baa7-465c-bfac-dac4554d5d5c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:53:55,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:53:55,895::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:53:55,896::task::1185::TaskManager.Task::(prepare) Task=`7af75b3a-baa7-465c-bfac-dac4554d5d5c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:53:55,896::task::595::TaskManager.Task::(_updateState) Task=`7af75b3a-baa7-465c-bfac-dac4554d5d5c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:53:55,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:53:55,897::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:53:55,897::task::990::TaskManager.Task::(_decref) Task=`7af75b3a-baa7-465c-bfac-dac4554d5d5c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:53:55,931::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:53:55,949::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000481379 s, 1.0 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:53:55,963::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 10:53:55,969::task::595::TaskManager.Task::(_updateState) Task=`7f8f8e7b-60c7-4bae-bf96-7d7d26482884`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:53:55,971::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:53:55,974::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`27d72f54-af4c-45a0-a889-5abc2f3abbcc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:53:55,974::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:53:55,976::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:53:55,977::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`27d72f54-af4c-45a0-a889-5abc2f3abbcc`::Granted request
>Thread-34::DEBUG::2014-08-21 10:53:55,977::task::827::TaskManager.Task::(resourceAcquired) Task=`7f8f8e7b-60c7-4bae-bf96-7d7d26482884`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:53:55,978::task::990::TaskManager.Task::(_decref) Task=`7f8f8e7b-60c7-4bae-bf96-7d7d26482884`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:53:55,984::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:55,984::task::1185::TaskManager.Task::(prepare) Task=`7f8f8e7b-60c7-4bae-bf96-7d7d26482884`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:53:55,984::task::595::TaskManager.Task::(_updateState) Task=`7f8f8e7b-60c7-4bae-bf96-7d7d26482884`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:53:55,985::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:53:55,985::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:53:55,985::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:53:55,985::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:53:55,986::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:53:55,986::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:53:55,986::task::990::TaskManager.Task::(_decref) Task=`7f8f8e7b-60c7-4bae-bf96-7d7d26482884`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:53:56,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:56,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0786931 s, 13.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:53:58,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:53:58,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.084793 s, 12.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:00,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:00,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0689935 s, 14.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:02,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:03,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.134539 s, 7.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:05,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:05,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.143374 s, 7.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:54:06,000::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-26::DEBUG::2014-08-21 10:54:06,002::task::595::TaskManager.Task::(_updateState) Task=`6d465fda-3ee9-458a-ac93-c611535eb21e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:54:06,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:54:06,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:54:06,003::task::1185::TaskManager.Task::(prepare) Task=`6d465fda-3ee9-458a-ac93-c611535eb21e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:54:06,004::task::595::TaskManager.Task::(_updateState) Task=`6d465fda-3ee9-458a-ac93-c611535eb21e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:54:06,006::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:54:06,007::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:54:06,011::task::990::TaskManager.Task::(_decref) Task=`6d465fda-3ee9-458a-ac93-c611535eb21e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:54:06,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:54:06,133::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-34::DEBUG::2014-08-21 10:54:06,142::task::595::TaskManager.Task::(_updateState) Task=`4e6547d7-e162-4e98-b29a-a72580d7d0eb`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 10:54:06,146::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00165753 s, 300 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:54:06,199::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:54:06,241::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c43675e9-afc5-479c-9d2a-04a5b1eea1da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:54:06,242::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:54:06,253::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:54:06,254::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c43675e9-afc5-479c-9d2a-04a5b1eea1da`::Granted request
>Thread-34::DEBUG::2014-08-21 10:54:06,600::task::827::TaskManager.Task::(resourceAcquired) Task=`4e6547d7-e162-4e98-b29a-a72580d7d0eb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:54:06,826::task::990::TaskManager.Task::(_decref) Task=`4e6547d7-e162-4e98-b29a-a72580d7d0eb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:54:07,518::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:07,851::task::1185::TaskManager.Task::(prepare) Task=`4e6547d7-e162-4e98-b29a-a72580d7d0eb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:07,852::task::595::TaskManager.Task::(_updateState) Task=`4e6547d7-e162-4e98-b29a-a72580d7d0eb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:54:07,852::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:54:07,852::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:54:07,853::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:54:07,854::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:54:07,854::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:54:07,855::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:54:07,855::task::990::TaskManager.Task::(_decref) Task=`4e6547d7-e162-4e98-b29a-a72580d7d0eb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:54:07,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:54:08,456::task::595::TaskManager.Task::(_updateState) Task=`f0b31186-8d9d-49a0-84ea-fa11fb690482`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:54:08,715::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:54:08,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00165753', 'lastCheck': '1.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:54:08,716::task::1185::TaskManager.Task::(prepare) Task=`f0b31186-8d9d-49a0-84ea-fa11fb690482`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00165753', 'lastCheck': '1.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:54:08,716::task::595::TaskManager.Task::(_updateState) Task=`f0b31186-8d9d-49a0-84ea-fa11fb690482`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:54:08,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:54:08,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:54:08,896::task::990::TaskManager.Task::(_decref) Task=`f0b31186-8d9d-49a0-84ea-fa11fb690482`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:54:15,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.802466 s, 1.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:54:17,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:54:17,181::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000460509 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:17,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:17,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0960479 s, 10.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:54:18,700::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-26::DEBUG::2014-08-21 10:54:18,704::task::595::TaskManager.Task::(_updateState) Task=`7f55513d-26bd-4002-a074-0908cd5320b4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:54:18,704::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:54:18,705::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:54:18,705::task::1185::TaskManager.Task::(prepare) Task=`7f55513d-26bd-4002-a074-0908cd5320b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:54:18,705::task::595::TaskManager.Task::(_updateState) Task=`7f55513d-26bd-4002-a074-0908cd5320b4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:54:18,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:54:18,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:54:18,706::task::990::TaskManager.Task::(_decref) Task=`7f55513d-26bd-4002-a074-0908cd5320b4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:54:18,724::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-34::DEBUG::2014-08-21 10:54:18,725::task::595::TaskManager.Task::(_updateState) Task=`fb3e21d1-7f0f-4d9c-a448-500cd901532e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:54:18,726::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:54:18,727::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2d0381ee-38a8-444d-9a61-204ddd4a6856`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:54:18,727::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:54:18,728::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:54:18,728::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2d0381ee-38a8-444d-9a61-204ddd4a6856`::Granted request
>Thread-34::DEBUG::2014-08-21 10:54:18,729::task::827::TaskManager.Task::(resourceAcquired) Task=`fb3e21d1-7f0f-4d9c-a448-500cd901532e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:54:18,729::task::990::TaskManager.Task::(_decref) Task=`fb3e21d1-7f0f-4d9c-a448-500cd901532e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:54:18,734::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:18,734::task::1185::TaskManager.Task::(prepare) Task=`fb3e21d1-7f0f-4d9c-a448-500cd901532e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:18,734::task::595::TaskManager.Task::(_updateState) Task=`fb3e21d1-7f0f-4d9c-a448-500cd901532e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:54:18,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:54:18,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:54:18,735::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:54:18,735::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:54:18,736::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:54:18,736::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:54:18,736::task::990::TaskManager.Task::(_decref) Task=`fb3e21d1-7f0f-4d9c-a448-500cd901532e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:54:19,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:21,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.17274 s, 873 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:23,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:23,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.305175 s, 3.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:25,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:54:27,556::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:54:27,620::task::595::TaskManager.Task::(_updateState) Task=`fa91a1cc-f057-4de7-a870-5a9a7f9da40d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:54:27,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:54:27,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460509', 'lastCheck': '10.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:54:27,622::task::1185::TaskManager.Task::(prepare) Task=`fa91a1cc-f057-4de7-a870-5a9a7f9da40d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460509', 'lastCheck': '10.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:54:27,622::task::595::TaskManager.Task::(_updateState) Task=`fa91a1cc-f057-4de7-a870-5a9a7f9da40d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:54:27,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:54:27,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:54:27,695::task::990::TaskManager.Task::(_decref) Task=`fa91a1cc-f057-4de7-a870-5a9a7f9da40d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:54:28,621::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0198318 s, 25.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:28,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.348106 s, 2.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:54:28,752::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-26::DEBUG::2014-08-21 10:54:28,753::task::595::TaskManager.Task::(_updateState) Task=`d61b493c-5bc2-4f74-8826-4c71f1cab19e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:54:28,755::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:54:28,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:54:28,759::task::1185::TaskManager.Task::(prepare) Task=`d61b493c-5bc2-4f74-8826-4c71f1cab19e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:54:28,760::task::595::TaskManager.Task::(_updateState) Task=`d61b493c-5bc2-4f74-8826-4c71f1cab19e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:54:28,762::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:54:28,763::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:54:28,764::task::990::TaskManager.Task::(_decref) Task=`d61b493c-5bc2-4f74-8826-4c71f1cab19e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:54:28,782::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-34::DEBUG::2014-08-21 10:54:28,785::task::595::TaskManager.Task::(_updateState) Task=`333fc814-825c-4414-8a02-1ba24be5142e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:54:28,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:54:28,793::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`76ed38e7-d8d2-4616-813c-c4259d2f2981`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:54:28,794::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:54:28,796::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:54:28,799::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`76ed38e7-d8d2-4616-813c-c4259d2f2981`::Granted request
>Thread-34::DEBUG::2014-08-21 10:54:28,803::task::827::TaskManager.Task::(resourceAcquired) Task=`333fc814-825c-4414-8a02-1ba24be5142e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:54:28,805::task::990::TaskManager.Task::(_decref) Task=`333fc814-825c-4414-8a02-1ba24be5142e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:54:28,837::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:28,839::task::1185::TaskManager.Task::(prepare) Task=`333fc814-825c-4414-8a02-1ba24be5142e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:28,839::task::595::TaskManager.Task::(_updateState) Task=`333fc814-825c-4414-8a02-1ba24be5142e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:54:28,840::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:54:28,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:54:28,843::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:54:28,845::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:54:28,846::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:54:28,847::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:54:28,848::task::990::TaskManager.Task::(_decref) Task=`333fc814-825c-4414-8a02-1ba24be5142e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:54:30,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:30,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.147052 s, 7.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:32,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:54:40,199::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-13::DEBUG::2014-08-21 10:54:40,201::task::595::TaskManager.Task::(_updateState) Task=`c488f116-6501-43df-aa16-c9c59cf2aaa1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:54:40,202::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:54:40,203::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:54:40,203::task::1185::TaskManager.Task::(prepare) Task=`c488f116-6501-43df-aa16-c9c59cf2aaa1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:54:40,204::task::595::TaskManager.Task::(_updateState) Task=`c488f116-6501-43df-aa16-c9c59cf2aaa1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:54:40,204::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:54:40,204::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:54:40,205::task::990::TaskManager.Task::(_decref) Task=`c488f116-6501-43df-aa16-c9c59cf2aaa1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:54:40,388::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-34::DEBUG::2014-08-21 10:54:40,389::task::595::TaskManager.Task::(_updateState) Task=`a7059b78-da24-429a-8208-fc3316f0873f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:54:40,390::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:54:40,392::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0bbbd71d-23ad-480f-904b-32e05c4a9336`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:54:40,393::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:54:40,393::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:54:40,394::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0bbbd71d-23ad-480f-904b-32e05c4a9336`::Granted request
>Thread-34::DEBUG::2014-08-21 10:54:40,395::task::827::TaskManager.Task::(resourceAcquired) Task=`a7059b78-da24-429a-8208-fc3316f0873f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:54:40,396::task::990::TaskManager.Task::(_decref) Task=`a7059b78-da24-429a-8208-fc3316f0873f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:54:40,407::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:40,407::task::1185::TaskManager.Task::(prepare) Task=`a7059b78-da24-429a-8208-fc3316f0873f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896784896', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:40,408::task::595::TaskManager.Task::(_updateState) Task=`a7059b78-da24-429a-8208-fc3316f0873f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:54:40,408::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:54:40,409::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:54:40,410::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:54:40,411::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:54:40,411::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:54:40,412::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:54:40,412::task::990::TaskManager.Task::(_decref) Task=`a7059b78-da24-429a-8208-fc3316f0873f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:54:41,733::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:42,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.00448 s, 146 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:54:42,292::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00694013 s, 71.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:44,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:45,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.513274 s, 2.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:54:50,448::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-26::DEBUG::2014-08-21 10:54:50,449::task::595::TaskManager.Task::(_updateState) Task=`30cd11a7-9ebd-46f0-a09a-57c5dd75b57e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:54:50,451::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:54:50,452::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:54:50,452::task::1185::TaskManager.Task::(prepare) Task=`30cd11a7-9ebd-46f0-a09a-57c5dd75b57e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:54:50,453::task::595::TaskManager.Task::(_updateState) Task=`30cd11a7-9ebd-46f0-a09a-57c5dd75b57e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:54:50,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:54:50,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:54:50,453::task::990::TaskManager.Task::(_decref) Task=`30cd11a7-9ebd-46f0-a09a-57c5dd75b57e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:54:50,467::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-34::DEBUG::2014-08-21 10:54:50,537::task::595::TaskManager.Task::(_updateState) Task=`449fe926-c1d2-4f90-88c0-bafce3f51b55`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:54:50,538::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:54:50,552::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`207cff90-563c-4df1-aed4-4112109bda84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:54:50,553::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:54:50,554::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:54:50,554::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`207cff90-563c-4df1-aed4-4112109bda84`::Granted request
>Thread-34::DEBUG::2014-08-21 10:54:50,555::task::827::TaskManager.Task::(resourceAcquired) Task=`449fe926-c1d2-4f90-88c0-bafce3f51b55`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:54:50,556::task::990::TaskManager.Task::(_decref) Task=`449fe926-c1d2-4f90-88c0-bafce3f51b55`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:54:50,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:50,666::task::1185::TaskManager.Task::(prepare) Task=`449fe926-c1d2-4f90-88c0-bafce3f51b55`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:54:50,669::task::595::TaskManager.Task::(_updateState) Task=`449fe926-c1d2-4f90-88c0-bafce3f51b55`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:54:50,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:54:50,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:54:50,731::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:54:50,746::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:54:50,747::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:54:50,753::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:54:50,755::task::990::TaskManager.Task::(_decref) Task=`449fe926-c1d2-4f90-88c0-bafce3f51b55`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:54:51,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:54:51,840::task::595::TaskManager.Task::(_updateState) Task=`5047e4c9-6979-493b-b130-38dfe3c6f404`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:54:51,841::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:54:51,842::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00694013', 'lastCheck': '9.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:54:51,842::task::1185::TaskManager.Task::(prepare) Task=`5047e4c9-6979-493b-b130-38dfe3c6f404`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00694013', 'lastCheck': '9.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:54:51,843::task::595::TaskManager.Task::(_updateState) Task=`5047e4c9-6979-493b-b130-38dfe3c6f404`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:54:51,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:54:51,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:54:51,900::task::990::TaskManager.Task::(_decref) Task=`5047e4c9-6979-493b-b130-38dfe3c6f404`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:54:53,029::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:54:54,522::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.109821 s, 4.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:54,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.848722 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:56,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:56,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.082804 s, 12.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:54:58,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:54:59,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.392842 s, 2.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:55:01,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:55:01,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.189775 s, 5.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:55:01,691::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-26::DEBUG::2014-08-21 10:55:01,692::task::595::TaskManager.Task::(_updateState) Task=`7c16671a-cdec-44ff-ab8e-7f1c93adb25a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:55:01,693::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:55:01,693::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:55:01,693::task::1185::TaskManager.Task::(prepare) Task=`7c16671a-cdec-44ff-ab8e-7f1c93adb25a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:55:01,694::task::595::TaskManager.Task::(_updateState) Task=`7c16671a-cdec-44ff-ab8e-7f1c93adb25a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:55:01,694::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:55:01,694::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:55:01,694::task::990::TaskManager.Task::(_decref) Task=`7c16671a-cdec-44ff-ab8e-7f1c93adb25a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:55:01,702::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-34::DEBUG::2014-08-21 10:55:01,703::task::595::TaskManager.Task::(_updateState) Task=`9eadde79-1b2f-40ad-850f-f7574b2bf48a`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:55:01,704::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:55:01,705::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`74f61e45-2ff2-4686-b12d-445b8d7636b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:55:01,705::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:55:01,706::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:55:01,706::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`74f61e45-2ff2-4686-b12d-445b8d7636b7`::Granted request
>Thread-34::DEBUG::2014-08-21 10:55:01,707::task::827::TaskManager.Task::(resourceAcquired) Task=`9eadde79-1b2f-40ad-850f-f7574b2bf48a`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:55:01,707::task::990::TaskManager.Task::(_decref) Task=`9eadde79-1b2f-40ad-850f-f7574b2bf48a`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:55:01,714::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:55:01,714::task::1185::TaskManager.Task::(prepare) Task=`9eadde79-1b2f-40ad-850f-f7574b2bf48a`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:55:01,714::task::595::TaskManager.Task::(_updateState) Task=`9eadde79-1b2f-40ad-850f-f7574b2bf48a`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:55:01,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:55:01,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:55:01,716::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:55:01,716::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:55:01,716::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:55:01,717::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:55:01,717::task::990::TaskManager.Task::(_decref) Task=`9eadde79-1b2f-40ad-850f-f7574b2bf48a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:55:03,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:55:03,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.1206 s, 8.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:55:35,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:55:35,224::task::595::TaskManager.Task::(_updateState) Task=`6950d66b-b48a-4f25-b77c-51b2b7bc6dcb`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 10:55:35,225::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-13::DEBUG::2014-08-21 10:55:35,269::task::595::TaskManager.Task::(_updateState) Task=`bd0c9bdf-a053-408b-a864-3e89bae5c89e`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 10:55:35,316::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::INFO::2014-08-21 10:55:35,382::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:55:35,387::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:55:35,413::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::INFO::2014-08-21 10:55:35,415::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.109821', 'lastCheck': '40.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:55:35,421::task::1185::TaskManager.Task::(prepare) Task=`bd0c9bdf-a053-408b-a864-3e89bae5c89e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:55:35,423::task::1185::TaskManager.Task::(prepare) Task=`6950d66b-b48a-4f25-b77c-51b2b7bc6dcb`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.109821', 'lastCheck': '40.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:55:35,432::task::595::TaskManager.Task::(_updateState) Task=`bd0c9bdf-a053-408b-a864-3e89bae5c89e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:55:35,433::task::595::TaskManager.Task::(_updateState) Task=`6950d66b-b48a-4f25-b77c-51b2b7bc6dcb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:55:35,441::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:55:35,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:55:35,450::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:55:35,451::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:55:35,461::task::990::TaskManager.Task::(_decref) Task=`bd0c9bdf-a053-408b-a864-3e89bae5c89e`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:55:35,463::task::990::TaskManager.Task::(_decref) Task=`6950d66b-b48a-4f25-b77c-51b2b7bc6dcb`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:55:35,481::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00111517 s, 447 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:55:35,507::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-34::DEBUG::2014-08-21 10:55:35,519::task::595::TaskManager.Task::(_updateState) Task=`b360e2e3-9261-4086-ae5c-550a225799e5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:55:35,528::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:55:35,544::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`97b7a707-52ac-4a9d-8f01-86ac56de023a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:55:35,551::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:55:35,561::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:55:35,564::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`97b7a707-52ac-4a9d-8f01-86ac56de023a`::Granted request
>Thread-34::DEBUG::2014-08-21 10:55:35,570::task::827::TaskManager.Task::(resourceAcquired) Task=`b360e2e3-9261-4086-ae5c-550a225799e5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:55:35,574::task::990::TaskManager.Task::(_decref) Task=`b360e2e3-9261-4086-ae5c-550a225799e5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:55:35,619::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:55:35,622::task::1185::TaskManager.Task::(prepare) Task=`b360e2e3-9261-4086-ae5c-550a225799e5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:55:35,624::task::595::TaskManager.Task::(_updateState) Task=`b360e2e3-9261-4086-ae5c-550a225799e5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:55:35,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:55:35,627::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:55:35,630::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:55:35,633::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:55:35,634::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:55:35,635::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:55:35,638::task::990::TaskManager.Task::(_decref) Task=`b360e2e3-9261-4086-ae5c-550a225799e5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:55:35,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.539434 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:55:37,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:55:38,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0556925 s, 18.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:55:40,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:55:43,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.625958 s, 1.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:55:46,180::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Dummy-33::DEBUG::2014-08-21 10:55:46,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:55:46,348::task::595::TaskManager.Task::(_updateState) Task=`86d4b5b9-0031-48b0-bca6-be721c37a7ae`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:55:46,349::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:55:46,351::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:55:46,351::task::1185::TaskManager.Task::(prepare) Task=`86d4b5b9-0031-48b0-bca6-be721c37a7ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-15::DEBUG::2014-08-21 10:55:46,638::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:55:46,830::task::595::TaskManager.Task::(_updateState) Task=`86d4b5b9-0031-48b0-bca6-be721c37a7ae`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:55:47,409::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:55:47,409::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:55:48,006::task::990::TaskManager.Task::(_decref) Task=`86d4b5b9-0031-48b0-bca6-be721c37a7ae`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:55:48,596::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00095337 s, 522 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:55:48,785::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 10:55:48,786::task::595::TaskManager.Task::(_updateState) Task=`bfd13c62-8d31-44fa-9129-064408b28775`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:55:48,787::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:55:48,788::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e2e7c13a-512e-4013-b452-bce17c6674c4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:55:48,788::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:55:48,789::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:55:48,789::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e2e7c13a-512e-4013-b452-bce17c6674c4`::Granted request
>Thread-34::DEBUG::2014-08-21 10:55:48,790::task::827::TaskManager.Task::(resourceAcquired) Task=`bfd13c62-8d31-44fa-9129-064408b28775`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:55:48,790::task::990::TaskManager.Task::(_decref) Task=`bfd13c62-8d31-44fa-9129-064408b28775`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:55:48,820::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:55:48,821::task::1185::TaskManager.Task::(prepare) Task=`bfd13c62-8d31-44fa-9129-064408b28775`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:55:48,821::task::595::TaskManager.Task::(_updateState) Task=`bfd13c62-8d31-44fa-9129-064408b28775`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:55:48,821::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:55:48,822::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:55:48,822::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:55:48,823::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:55:48,823::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:55:48,823::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:55:48,824::task::990::TaskManager.Task::(_decref) Task=`bfd13c62-8d31-44fa-9129-064408b28775`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:55:50,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.38367 s, 303 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:55:52,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:56:09,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.78057 s, 368 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:56:09,712::task::595::TaskManager.Task::(_updateState) Task=`1283b630-9978-4c2d-b692-56c97ce815d9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:56:09,847::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:56:09,868::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00095337', 'lastCheck': '20.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:56:09,869::task::1185::TaskManager.Task::(prepare) Task=`1283b630-9978-4c2d-b692-56c97ce815d9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00095337', 'lastCheck': '20.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:56:09,943::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-13::DEBUG::2014-08-21 10:56:09,974::task::595::TaskManager.Task::(_updateState) Task=`5cb9fcba-7e44-47f6-99db-eed578b30a61`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 10:56:10,008::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:56:10,249::task::595::TaskManager.Task::(_updateState) Task=`1283b630-9978-4c2d-b692-56c97ce815d9`::moving from state preparing -> state finished
>Thread-13::INFO::2014-08-21 10:56:10,306::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:56:10,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0218145 s, 22.8 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:56:10,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::INFO::2014-08-21 10:56:10,361::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:56:10,861::task::1185::TaskManager.Task::(prepare) Task=`5cb9fcba-7e44-47f6-99db-eed578b30a61`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:56:10,882::task::595::TaskManager.Task::(_updateState) Task=`5cb9fcba-7e44-47f6-99db-eed578b30a61`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:56:10,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:56:10,885::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:56:10,897::task::990::TaskManager.Task::(_decref) Task=`5cb9fcba-7e44-47f6-99db-eed578b30a61`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:56:10,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:56:10,957::task::990::TaskManager.Task::(_decref) Task=`1283b630-9978-4c2d-b692-56c97ce815d9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:56:11,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 10:56:11,375::task::595::TaskManager.Task::(_updateState) Task=`c657d31c-c341-4759-b05d-619335b706ae`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:56:11,376::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:56:11,412::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6461816c-4257-41fd-bc02-4f4643b348ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:56:11,684::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:56:11,699::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:56:11,700::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6461816c-4257-41fd-bc02-4f4643b348ff`::Granted request
>Thread-34::DEBUG::2014-08-21 10:56:11,750::task::827::TaskManager.Task::(resourceAcquired) Task=`c657d31c-c341-4759-b05d-619335b706ae`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:56:11,763::task::990::TaskManager.Task::(_decref) Task=`c657d31c-c341-4759-b05d-619335b706ae`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:56:12,125::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:56:12,139::task::1185::TaskManager.Task::(prepare) Task=`c657d31c-c341-4759-b05d-619335b706ae`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:56:12,152::task::595::TaskManager.Task::(_updateState) Task=`c657d31c-c341-4759-b05d-619335b706ae`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:56:12,161::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:56:12,162::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:56:12,178::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:56:12,202::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:56:12,203::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:56:12,203::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:56:12,218::task::990::TaskManager.Task::(_decref) Task=`c657d31c-c341-4759-b05d-619335b706ae`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:56:12,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:56:14,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.446269 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:56:16,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:56:17,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.681109 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:56:21,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:56:23,947::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-13::DEBUG::2014-08-21 10:56:23,950::task::595::TaskManager.Task::(_updateState) Task=`06b85e4f-cd5a-4ea8-b0f7-4b1b20beecc0`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:56:23,951::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:56:23,952::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:56:23,953::task::1185::TaskManager.Task::(prepare) Task=`06b85e4f-cd5a-4ea8-b0f7-4b1b20beecc0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:56:23,954::task::595::TaskManager.Task::(_updateState) Task=`06b85e4f-cd5a-4ea8-b0f7-4b1b20beecc0`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:56:24,219::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:56:24,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:56:24,220::task::990::TaskManager.Task::(_decref) Task=`06b85e4f-cd5a-4ea8-b0f7-4b1b20beecc0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:56:25,387::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 10:56:25,388::task::595::TaskManager.Task::(_updateState) Task=`2ab0e745-8d6f-4be4-a510-6c9087f62eec`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 10:56:26,023::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:56:26,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:56:26,320::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`87741cdc-7441-4e8e-814d-499ac11e5cdd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:56:26,324::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:56:26,551::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:56:26,567::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`87741cdc-7441-4e8e-814d-499ac11e5cdd`::Granted request
>Thread-34::DEBUG::2014-08-21 10:56:26,675::task::827::TaskManager.Task::(resourceAcquired) Task=`2ab0e745-8d6f-4be4-a510-6c9087f62eec`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:56:26,684::task::990::TaskManager.Task::(_decref) Task=`2ab0e745-8d6f-4be4-a510-6c9087f62eec`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:56:26,741::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00689559 s, 72.2 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:56:27,256::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:56:27,283::task::1185::TaskManager.Task::(prepare) Task=`2ab0e745-8d6f-4be4-a510-6c9087f62eec`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:56:27,284::task::595::TaskManager.Task::(_updateState) Task=`2ab0e745-8d6f-4be4-a510-6c9087f62eec`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:56:27,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:56:27,285::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:56:27,286::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:56:27,286::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:56:27,290::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:56:27,291::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:56:27,292::task::990::TaskManager.Task::(_decref) Task=`2ab0e745-8d6f-4be4-a510-6c9087f62eec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:56:27,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.36523 s, 191 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:56:29,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:56:29,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150389 s, 6.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:56:31,618::task::595::TaskManager.Task::(_updateState) Task=`5fe75fbf-71df-4b08-a45c-bed4e741138c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:56:31,632::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:56:31,632::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00689559', 'lastCheck': '4.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:56:31,633::task::1185::TaskManager.Task::(prepare) Task=`5fe75fbf-71df-4b08-a45c-bed4e741138c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00689559', 'lastCheck': '4.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:56:31,633::task::595::TaskManager.Task::(_updateState) Task=`5fe75fbf-71df-4b08-a45c-bed4e741138c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:56:31,635::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:56:31,635::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:56:31,635::task::990::TaskManager.Task::(_decref) Task=`5fe75fbf-71df-4b08-a45c-bed4e741138c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:56:32,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:56:35,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.73279 s, 375 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:56:37,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:56:37,351::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [709eb53e]
>Thread-26::DEBUG::2014-08-21 10:56:37,353::task::595::TaskManager.Task::(_updateState) Task=`3760e69f-b75d-4765-8c93-0a69e53aeee6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:56:37,353::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:56:37,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:56:37,356::task::1185::TaskManager.Task::(prepare) Task=`3760e69f-b75d-4765-8c93-0a69e53aeee6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:56:37,356::task::595::TaskManager.Task::(_updateState) Task=`3760e69f-b75d-4765-8c93-0a69e53aeee6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:56:37,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:56:37,357::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:56:37,357::task::990::TaskManager.Task::(_decref) Task=`3760e69f-b75d-4765-8c93-0a69e53aeee6`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:56:38,943::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [709eb53e]
>Thread-34::DEBUG::2014-08-21 10:56:38,959::task::595::TaskManager.Task::(_updateState) Task=`6c60d5c9-bf74-40d9-930f-c68a7ef9c328`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:56:39,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:56:39,019::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac90d945-2350-4805-865d-f29b76424594`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:56:39,019::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:56:39,424::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:56:39,429::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac90d945-2350-4805-865d-f29b76424594`::Granted request
>Thread-34::DEBUG::2014-08-21 10:56:39,750::task::827::TaskManager.Task::(resourceAcquired) Task=`6c60d5c9-bf74-40d9-930f-c68a7ef9c328`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:56:39,750::task::990::TaskManager.Task::(_decref) Task=`6c60d5c9-bf74-40d9-930f-c68a7ef9c328`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:56:39,722::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:56:40,044::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:56:40,045::task::1185::TaskManager.Task::(prepare) Task=`6c60d5c9-bf74-40d9-930f-c68a7ef9c328`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:56:40,045::task::595::TaskManager.Task::(_updateState) Task=`6c60d5c9-bf74-40d9-930f-c68a7ef9c328`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:56:40,046::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:56:40,046::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:56:40,047::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:56:40,048::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:56:40,049::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:56:40,049::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:56:40,050::task::990::TaskManager.Task::(_decref) Task=`6c60d5c9-bf74-40d9-930f-c68a7ef9c328`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:56:40,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00133392 s, 373 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:56:40,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.93024 s, 349 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:56:42,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:56:42,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.191417 s, 5.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:56:44,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:56:58,627::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-13::DEBUG::2014-08-21 10:56:58,674::task::595::TaskManager.Task::(_updateState) Task=`4012f0a0-dcd1-4b0a-ae05-5f135b3e7274`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:56:58,688::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:56:58,692::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:56:58,695::task::1185::TaskManager.Task::(prepare) Task=`4012f0a0-dcd1-4b0a-ae05-5f135b3e7274`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:56:58,792::task::595::TaskManager.Task::(_updateState) Task=`bc55c247-3946-48d5-9a36-131837f9bfcb`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 10:56:59,383::task::595::TaskManager.Task::(_updateState) Task=`4012f0a0-dcd1-4b0a-ae05-5f135b3e7274`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:56:59,406::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::INFO::2014-08-21 10:56:59,407::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::DEBUG::2014-08-21 10:56:59,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::INFO::2014-08-21 10:56:59,416::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133392', 'lastCheck': '19.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:56:59,422::task::1185::TaskManager.Task::(prepare) Task=`bc55c247-3946-48d5-9a36-131837f9bfcb`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133392', 'lastCheck': '19.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:56:59,422::task::990::TaskManager.Task::(_decref) Task=`4012f0a0-dcd1-4b0a-ae05-5f135b3e7274`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:56:59,426::task::595::TaskManager.Task::(_updateState) Task=`bc55c247-3946-48d5-9a36-131837f9bfcb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:56:59,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:56:59,436::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:56:59,441::task::990::TaskManager.Task::(_decref) Task=`bc55c247-3946-48d5-9a36-131837f9bfcb`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:56:59,508::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-34::DEBUG::2014-08-21 10:56:59,516::task::595::TaskManager.Task::(_updateState) Task=`f238a6c4-7fc9-437e-b508-d008de2eb259`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:56:59,525::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:56:59,545::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a6c7d0c7-eb58-434b-971c-e280953fd92d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:56:59,551::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:56:59,564::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:56:59,568::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a6c7d0c7-eb58-434b-971c-e280953fd92d`::Granted request
>Thread-34::DEBUG::2014-08-21 10:56:59,585::task::827::TaskManager.Task::(resourceAcquired) Task=`f238a6c4-7fc9-437e-b508-d008de2eb259`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:56:59,590::task::990::TaskManager.Task::(_decref) Task=`f238a6c4-7fc9-437e-b508-d008de2eb259`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:56:59,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:56:59,745::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:56:59,750::task::1185::TaskManager.Task::(prepare) Task=`f238a6c4-7fc9-437e-b508-d008de2eb259`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:56:59,757::task::595::TaskManager.Task::(_updateState) Task=`f238a6c4-7fc9-437e-b508-d008de2eb259`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:56:59,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:56:59,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:56:59,780::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-15::DEBUG::2014-08-21 10:56:59,784::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000549134 s, 907 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:56:59,784::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:56:59,789::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:56:59,791::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:56:59,796::task::990::TaskManager.Task::(_decref) Task=`f238a6c4-7fc9-437e-b508-d008de2eb259`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:56:59,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 15.3042 s, 66.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:02,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:57:03,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0959476 s, 10.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:05,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:57:06,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.188016 s, 5.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:08,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:57:09,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.35939 s, 753 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:57:09,829::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-26::DEBUG::2014-08-21 10:57:09,831::task::595::TaskManager.Task::(_updateState) Task=`7fd6b676-ae0e-41e5-b26f-7f2b3c374b56`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:57:09,832::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:57:09,833::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:57:09,834::task::1185::TaskManager.Task::(prepare) Task=`7fd6b676-ae0e-41e5-b26f-7f2b3c374b56`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:57:09,834::task::595::TaskManager.Task::(_updateState) Task=`7fd6b676-ae0e-41e5-b26f-7f2b3c374b56`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:57:09,841::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:57:09,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:57:09,844::task::990::TaskManager.Task::(_decref) Task=`7fd6b676-ae0e-41e5-b26f-7f2b3c374b56`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:57:09,896::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:57:10,059::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-34::DEBUG::2014-08-21 10:57:10,064::task::595::TaskManager.Task::(_updateState) Task=`2257e467-b3f3-47a6-a174-edfea5ac172e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:57:10,066::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:57:10,070::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3ea08366-4074-47f0-b0eb-e58046c17516`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:57:10,071::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:57:10,074::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:57:10,075::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3ea08366-4074-47f0-b0eb-e58046c17516`::Granted request
>Thread-34::DEBUG::2014-08-21 10:57:10,079::task::827::TaskManager.Task::(resourceAcquired) Task=`2257e467-b3f3-47a6-a174-edfea5ac172e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-15::DEBUG::2014-08-21 10:57:10,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0966426 s, 5.2 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:57:10,081::task::990::TaskManager.Task::(_decref) Task=`2257e467-b3f3-47a6-a174-edfea5ac172e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:57:10,102::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:57:10,102::task::1185::TaskManager.Task::(prepare) Task=`2257e467-b3f3-47a6-a174-edfea5ac172e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:57:10,103::task::595::TaskManager.Task::(_updateState) Task=`2257e467-b3f3-47a6-a174-edfea5ac172e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:57:10,103::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:57:10,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:57:10,103::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:57:10,104::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:57:10,104::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:57:10,104::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:57:10,104::task::990::TaskManager.Task::(_decref) Task=`2257e467-b3f3-47a6-a174-edfea5ac172e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:57:11,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:57:16,662::task::595::TaskManager.Task::(_updateState) Task=`e1b40762-cca2-4bc9-a0ff-f0ffab2981ec`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:57:16,687::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:57:16,858::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0966426', 'lastCheck': '6.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:57:16,908::task::1185::TaskManager.Task::(prepare) Task=`e1b40762-cca2-4bc9-a0ff-f0ffab2981ec`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0966426', 'lastCheck': '6.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:57:16,989::task::595::TaskManager.Task::(_updateState) Task=`e1b40762-cca2-4bc9-a0ff-f0ffab2981ec`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:57:17,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:57:17,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:57:17,191::task::990::TaskManager.Task::(_decref) Task=`e1b40762-cca2-4bc9-a0ff-f0ffab2981ec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:57:17,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.50077 s, 293 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:22,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:57:23,385::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-26::DEBUG::2014-08-21 10:57:23,392::task::595::TaskManager.Task::(_updateState) Task=`2411cb72-cd6b-44a4-b5b4-78e56d0f32ff`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:57:23,397::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:57:23,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:57:23,399::task::1185::TaskManager.Task::(prepare) Task=`2411cb72-cd6b-44a4-b5b4-78e56d0f32ff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:57:23,399::task::595::TaskManager.Task::(_updateState) Task=`2411cb72-cd6b-44a4-b5b4-78e56d0f32ff`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:57:23,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:57:23,406::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:57:23,407::task::990::TaskManager.Task::(_decref) Task=`2411cb72-cd6b-44a4-b5b4-78e56d0f32ff`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:57:24,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:57:24,587::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0164619 s, 30.3 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:57:24,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-34::DEBUG::2014-08-21 10:57:24,634::task::595::TaskManager.Task::(_updateState) Task=`e3ec3a73-10c0-4209-be8d-5fa26bf99072`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:57:24,636::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:57:24,640::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`93565c4f-e46d-46f3-baa1-20b4ffe17e04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:57:24,641::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:57:24,643::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:57:24,643::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`93565c4f-e46d-46f3-baa1-20b4ffe17e04`::Granted request
>Thread-34::DEBUG::2014-08-21 10:57:24,645::task::827::TaskManager.Task::(resourceAcquired) Task=`e3ec3a73-10c0-4209-be8d-5fa26bf99072`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:57:24,645::task::990::TaskManager.Task::(_decref) Task=`e3ec3a73-10c0-4209-be8d-5fa26bf99072`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:57:24,701::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:57:24,702::task::1185::TaskManager.Task::(prepare) Task=`e3ec3a73-10c0-4209-be8d-5fa26bf99072`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:57:24,702::task::595::TaskManager.Task::(_updateState) Task=`e3ec3a73-10c0-4209-be8d-5fa26bf99072`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:57:24,703::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:57:24,704::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:57:24,705::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:57:24,706::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:57:24,706::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:57:24,707::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:57:24,708::task::990::TaskManager.Task::(_decref) Task=`e3ec3a73-10c0-4209-be8d-5fa26bf99072`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:57:25,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.49558 s, 685 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:27,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:57:27,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.195227 s, 5.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:29,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:57:29,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0485426 s, 21.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:31,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:57:31,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0481902 s, 21.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:33,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:57:34,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0756806 s, 13.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:36,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:57:43,118::task::595::TaskManager.Task::(_updateState) Task=`ab493520-aebd-459d-9ebf-d614f7e4ef10`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:57:43,907::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:57:44,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0164619', 'lastCheck': '19.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:57:44,056::task::1185::TaskManager.Task::(prepare) Task=`ab493520-aebd-459d-9ebf-d614f7e4ef10`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0164619', 'lastCheck': '19.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:57:44,409::task::595::TaskManager.Task::(_updateState) Task=`ab493520-aebd-459d-9ebf-d614f7e4ef10`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:57:44,439::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:57:44,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:57:44,566::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Thread-13::DEBUG::2014-08-21 10:57:44,718::task::990::TaskManager.Task::(_decref) Task=`ab493520-aebd-459d-9ebf-d614f7e4ef10`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:57:45,135::task::595::TaskManager.Task::(_updateState) Task=`eef47855-ae3d-4ce5-b5ec-a3c2e8c05eb6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:57:45,734::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:57:45,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::INFO::2014-08-21 10:57:45,983::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:57:45,985::task::1185::TaskManager.Task::(prepare) Task=`eef47855-ae3d-4ce5-b5ec-a3c2e8c05eb6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:57:46,010::task::595::TaskManager.Task::(_updateState) Task=`eef47855-ae3d-4ce5-b5ec-a3c2e8c05eb6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:57:46,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:57:46,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:57:46,012::task::990::TaskManager.Task::(_decref) Task=`eef47855-ae3d-4ce5-b5ec-a3c2e8c05eb6`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:57:46,286::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00769838 s, 64.7 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:57:46,344::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Thread-34::DEBUG::2014-08-21 10:57:46,346::task::595::TaskManager.Task::(_updateState) Task=`1a4d2840-f294-4d0b-96c2-eb25fbae2229`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:57:46,346::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:57:46,361::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cbd050a9-80ee-4009-b9b5-7620eb8c1dbb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:57:46,362::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:57:46,362::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:57:46,363::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cbd050a9-80ee-4009-b9b5-7620eb8c1dbb`::Granted request
>Thread-34::DEBUG::2014-08-21 10:57:46,363::task::827::TaskManager.Task::(resourceAcquired) Task=`1a4d2840-f294-4d0b-96c2-eb25fbae2229`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:57:46,364::task::990::TaskManager.Task::(_decref) Task=`1a4d2840-f294-4d0b-96c2-eb25fbae2229`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:57:46,474::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:57:46,475::task::1185::TaskManager.Task::(prepare) Task=`1a4d2840-f294-4d0b-96c2-eb25fbae2229`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:57:46,475::task::595::TaskManager.Task::(_updateState) Task=`1a4d2840-f294-4d0b-96c2-eb25fbae2229`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:57:46,475::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:57:46,476::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:57:46,476::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:57:46,477::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:57:46,477::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:57:46,477::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:57:46,477::task::990::TaskManager.Task::(_decref) Task=`1a4d2840-f294-4d0b-96c2-eb25fbae2229`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:57:47,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.5215 s, 97.3 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:49,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:57:52,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.00702 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:57:54,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:57:56,668::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-13::DEBUG::2014-08-21 10:57:56,671::task::595::TaskManager.Task::(_updateState) Task=`72c532bd-4892-4efe-bc9e-4af07bd108cc`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:57:56,671::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:57:56,673::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:57:56,673::task::1185::TaskManager.Task::(prepare) Task=`72c532bd-4892-4efe-bc9e-4af07bd108cc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:57:56,674::task::595::TaskManager.Task::(_updateState) Task=`72c532bd-4892-4efe-bc9e-4af07bd108cc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:57:56,674::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:57:56,674::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:57:56,674::task::990::TaskManager.Task::(_decref) Task=`72c532bd-4892-4efe-bc9e-4af07bd108cc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:57:56,973::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-34::DEBUG::2014-08-21 10:57:56,985::task::595::TaskManager.Task::(_updateState) Task=`1a810e4f-3261-4bc5-9432-7fa02ed46be2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:57:56,991::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:57:57,019::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9b93ebcf-91b6-4b2d-8a5c-a8c561f035c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:57:57,020::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:57:57,047::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:57:57,050::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9b93ebcf-91b6-4b2d-8a5c-a8c561f035c9`::Granted request
>Thread-34::DEBUG::2014-08-21 10:57:57,079::task::827::TaskManager.Task::(resourceAcquired) Task=`1a810e4f-3261-4bc5-9432-7fa02ed46be2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:57:57,080::task::990::TaskManager.Task::(_decref) Task=`1a810e4f-3261-4bc5-9432-7fa02ed46be2`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:57:57,395::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:57:57,679::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00255854 s, 195 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:57:57,792::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:57:57,932::task::1185::TaskManager.Task::(prepare) Task=`1a810e4f-3261-4bc5-9432-7fa02ed46be2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:57:57,934::task::595::TaskManager.Task::(_updateState) Task=`1a810e4f-3261-4bc5-9432-7fa02ed46be2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:57:57,934::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:57:57,935::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:57:57,941::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:57:57,942::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:57:57,943::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:57:57,944::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:57:58,013::task::990::TaskManager.Task::(_decref) Task=`1a810e4f-3261-4bc5-9432-7fa02ed46be2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:58:03,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.1742 s, 125 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:05,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:58:12,049::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d519215]
>Thread-13::DEBUG::2014-08-21 10:58:12,055::task::595::TaskManager.Task::(_updateState) Task=`11a17418-0699-46ed-8e75-3e95f10f4560`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:58:12,058::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:58:12,061::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:58:12,064::task::1185::TaskManager.Task::(prepare) Task=`11a17418-0699-46ed-8e75-3e95f10f4560`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:58:12,071::task::595::TaskManager.Task::(_updateState) Task=`11a17418-0699-46ed-8e75-3e95f10f4560`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:58:12,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:58:12,078::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:58:12,083::task::990::TaskManager.Task::(_decref) Task=`11a17418-0699-46ed-8e75-3e95f10f4560`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:58:12,103::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d519215]
>Thread-34::DEBUG::2014-08-21 10:58:12,106::task::595::TaskManager.Task::(_updateState) Task=`06916054-b786-417b-968d-255927366c99`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:58:12,109::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:58:12,126::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4536e3ee-7c9c-40e8-8125-eced46d3c907`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:58:12,129::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:58:12,147::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:58:12,154::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4536e3ee-7c9c-40e8-8125-eced46d3c907`::Granted request
>Thread-34::DEBUG::2014-08-21 10:58:12,171::task::827::TaskManager.Task::(resourceAcquired) Task=`06916054-b786-417b-968d-255927366c99`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:58:12,179::task::990::TaskManager.Task::(_decref) Task=`06916054-b786-417b-968d-255927366c99`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:58:12,286::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:12,289::task::1185::TaskManager.Task::(prepare) Task=`06916054-b786-417b-968d-255927366c99`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:12,292::task::595::TaskManager.Task::(_updateState) Task=`06916054-b786-417b-968d-255927366c99`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:58:12,295::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:58:12,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 10:58:12,310::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:58:12,322::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:58:12,326::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:58:12,327::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:58:12,329::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:58:12,332::task::990::TaskManager.Task::(_decref) Task=`06916054-b786-417b-968d-255927366c99`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:58:12,353::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000446166 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:12,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.06909 s, 334 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:14,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:58:14,867::task::595::TaskManager.Task::(_updateState) Task=`9c03d86e-9321-4a31-bdae-2f49072db7d9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:58:14,868::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:58:14,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446166', 'lastCheck': '2.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:58:14,870::task::1185::TaskManager.Task::(prepare) Task=`9c03d86e-9321-4a31-bdae-2f49072db7d9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446166', 'lastCheck': '2.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:58:14,871::task::595::TaskManager.Task::(_updateState) Task=`9c03d86e-9321-4a31-bdae-2f49072db7d9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:58:14,871::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:58:14,872::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:58:14,872::task::990::TaskManager.Task::(_decref) Task=`9c03d86e-9321-4a31-bdae-2f49072db7d9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:58:15,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.294096 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:17,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:17,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0710086 s, 14.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:19,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:19,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0488793 s, 20.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:21,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:22,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.127634 s, 8.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:58:22,818::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-13::DEBUG::2014-08-21 10:58:22,839::task::595::TaskManager.Task::(_updateState) Task=`7274dbb0-26ae-4d4b-adee-dc81574644e3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:58:22,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:58:22,939::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::INFO::2014-08-21 10:58:23,090::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:58:23,119::task::1185::TaskManager.Task::(prepare) Task=`7274dbb0-26ae-4d4b-adee-dc81574644e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:58:23,230::task::595::TaskManager.Task::(_updateState) Task=`7274dbb0-26ae-4d4b-adee-dc81574644e3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:58:23,237::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:58:23,243::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:58:23,251::task::990::TaskManager.Task::(_decref) Task=`7274dbb0-26ae-4d4b-adee-dc81574644e3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:58:23,292::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-15::DEBUG::2014-08-21 10:58:23,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00808412 s, 61.6 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:58:23,301::task::595::TaskManager.Task::(_updateState) Task=`7a65f933-21f3-4686-b3a3-3248f3863d0e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:58:23,306::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:58:23,321::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2e64acaa-cb5f-4b6a-8606-b1231b9ba712`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:58:23,322::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:58:23,324::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:58:23,325::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2e64acaa-cb5f-4b6a-8606-b1231b9ba712`::Granted request
>Thread-34::DEBUG::2014-08-21 10:58:23,329::task::827::TaskManager.Task::(resourceAcquired) Task=`7a65f933-21f3-4686-b3a3-3248f3863d0e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:58:23,331::task::990::TaskManager.Task::(_decref) Task=`7a65f933-21f3-4686-b3a3-3248f3863d0e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:58:23,375::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:23,376::task::1185::TaskManager.Task::(prepare) Task=`7a65f933-21f3-4686-b3a3-3248f3863d0e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:23,378::task::595::TaskManager.Task::(_updateState) Task=`7a65f933-21f3-4686-b3a3-3248f3863d0e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:58:23,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:58:23,380::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:58:23,393::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:58:23,394::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:58:23,395::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:58:23,397::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:58:23,398::task::990::TaskManager.Task::(_decref) Task=`7a65f933-21f3-4686-b3a3-3248f3863d0e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:58:25,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:25,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0745581 s, 13.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:27,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:28,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.402109 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:30,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:58:32,452::task::595::TaskManager.Task::(_updateState) Task=`a2ea9450-9f0b-4ffc-aa7f-95a2bd27600e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:58:32,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:58:32,485::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00808412', 'lastCheck': '9.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:58:32,486::task::1185::TaskManager.Task::(prepare) Task=`a2ea9450-9f0b-4ffc-aa7f-95a2bd27600e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00808412', 'lastCheck': '9.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:58:32,486::task::595::TaskManager.Task::(_updateState) Task=`a2ea9450-9f0b-4ffc-aa7f-95a2bd27600e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:58:32,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:58:32,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:58:32,559::task::990::TaskManager.Task::(_decref) Task=`a2ea9450-9f0b-4ffc-aa7f-95a2bd27600e`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 10:58:33,873::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-26::DEBUG::2014-08-21 10:58:34,448::task::595::TaskManager.Task::(_updateState) Task=`ace5a471-7f19-4560-89dc-8e8ae68eaf08`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:58:34,450::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:58:34,477::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:58:34,492::task::1185::TaskManager.Task::(prepare) Task=`ace5a471-7f19-4560-89dc-8e8ae68eaf08`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:58:34,695::task::595::TaskManager.Task::(_updateState) Task=`ace5a471-7f19-4560-89dc-8e8ae68eaf08`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:58:34,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:58:34,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:58:35,203::task::990::TaskManager.Task::(_decref) Task=`ace5a471-7f19-4560-89dc-8e8ae68eaf08`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:58:36,151::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:58:37,440::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-34::DEBUG::2014-08-21 10:58:37,451::task::595::TaskManager.Task::(_updateState) Task=`46ab505f-43e8-4bbe-be58-58f8411d3c80`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:58:37,459::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:58:37,484::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e8a03966-4aa8-4034-8576-5bcb70d1c601`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:58:37,489::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:58:37,498::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:58:37,503::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e8a03966-4aa8-4034-8576-5bcb70d1c601`::Granted request
>Thread-34::DEBUG::2014-08-21 10:58:37,516::task::827::TaskManager.Task::(resourceAcquired) Task=`46ab505f-43e8-4bbe-be58-58f8411d3c80`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:58:37,519::task::990::TaskManager.Task::(_decref) Task=`46ab505f-43e8-4bbe-be58-58f8411d3c80`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 10:58:37,590::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0498391 s, 10.0 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 10:58:37,605::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:37,609::task::1185::TaskManager.Task::(prepare) Task=`46ab505f-43e8-4bbe-be58-58f8411d3c80`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:37,616::task::595::TaskManager.Task::(_updateState) Task=`46ab505f-43e8-4bbe-be58-58f8411d3c80`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:58:37,620::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:58:37,623::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:58:37,627::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:58:37,633::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:58:37,637::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:58:37,640::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:58:37,648::task::990::TaskManager.Task::(_decref) Task=`46ab505f-43e8-4bbe-be58-58f8411d3c80`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:58:37,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.88128 s, 355 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:39,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:45,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.713626 s, 1.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 10:58:47,663::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 10:58:47,824::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Dummy-33::DEBUG::2014-08-21 10:58:48,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 10:58:48,064::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-13::DEBUG::2014-08-21 10:58:48,065::task::595::TaskManager.Task::(_updateState) Task=`53f5f537-6b51-4cbc-a0b6-87679d15b50c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:58:48,066::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:58:48,067::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 10:58:48,197::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 10:58:48,202::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 10:58:48,202::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 10:58:48,203::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-13::INFO::2014-08-21 10:58:48,204::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:58:48,208::task::1185::TaskManager.Task::(prepare) Task=`53f5f537-6b51-4cbc-a0b6-87679d15b50c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:58:48,209::task::595::TaskManager.Task::(_updateState) Task=`53f5f537-6b51-4cbc-a0b6-87679d15b50c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:58:48,210::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:58:48,210::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:58:48,213::task::990::TaskManager.Task::(_decref) Task=`53f5f537-6b51-4cbc-a0b6-87679d15b50c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:58:48,223::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-34::DEBUG::2014-08-21 10:58:48,227::task::595::TaskManager.Task::(_updateState) Task=`3c70f239-4afc-457e-8ba2-b7d4dcaa318e`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 10:58:48,229::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 10:58:48,230::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:58:48,241::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d7af376f-7fc9-4cf8-8ac3-1cec21f20037`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:58:48,242::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:58:48,246::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:58:48,248::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d7af376f-7fc9-4cf8-8ac3-1cec21f20037`::Granted request
>Thread-34::DEBUG::2014-08-21 10:58:48,252::task::827::TaskManager.Task::(resourceAcquired) Task=`3c70f239-4afc-457e-8ba2-b7d4dcaa318e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:58:48,254::task::990::TaskManager.Task::(_decref) Task=`3c70f239-4afc-457e-8ba2-b7d4dcaa318e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:58:48,281::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:48,283::task::1185::TaskManager.Task::(prepare) Task=`3c70f239-4afc-457e-8ba2-b7d4dcaa318e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:48,285::task::595::TaskManager.Task::(_updateState) Task=`3c70f239-4afc-457e-8ba2-b7d4dcaa318e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:58:48,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:58:48,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:58:48,289::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:58:48,291::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:58:48,292::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:58:48,293::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:58:48,295::task::990::TaskManager.Task::(_decref) Task=`3c70f239-4afc-457e-8ba2-b7d4dcaa318e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:58:48,308::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00062482 s, 797 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:48,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.298857 s, 3.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:50,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:50,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.167743 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:52,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:53,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.13706 s, 7.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:58:54,630::task::595::TaskManager.Task::(_updateState) Task=`a392a1ff-6a3d-4885-8aad-d38293e667ca`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:58:54,631::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 10:58:54,631::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062482', 'lastCheck': '6.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:58:54,632::task::1185::TaskManager.Task::(prepare) Task=`a392a1ff-6a3d-4885-8aad-d38293e667ca`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062482', 'lastCheck': '6.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 10:58:54,632::task::595::TaskManager.Task::(_updateState) Task=`a392a1ff-6a3d-4885-8aad-d38293e667ca`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:58:54,632::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:58:54,633::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:58:54,633::task::990::TaskManager.Task::(_decref) Task=`a392a1ff-6a3d-4885-8aad-d38293e667ca`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:58:55,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:55,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0749805 s, 13.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:58:57,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:57,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0478828 s, 21.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 10:58:58,325::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-13::DEBUG::2014-08-21 10:58:58,326::task::595::TaskManager.Task::(_updateState) Task=`fa100a06-da45-41e5-829f-ffd6e2e141d4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 10:58:58,326::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 10:58:58,327::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:58:58,327::task::1185::TaskManager.Task::(prepare) Task=`fa100a06-da45-41e5-829f-ffd6e2e141d4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 10:58:58,327::task::595::TaskManager.Task::(_updateState) Task=`fa100a06-da45-41e5-829f-ffd6e2e141d4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 10:58:58,327::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 10:58:58,328::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 10:58:58,328::task::990::TaskManager.Task::(_decref) Task=`fa100a06-da45-41e5-829f-ffd6e2e141d4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:58:58,342::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:58:58,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-34::DEBUG::2014-08-21 10:58:58,365::task::595::TaskManager.Task::(_updateState) Task=`88ce901b-5ad2-4714-b69f-ee371cc6e2ca`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:58:58,366::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:58:58,369::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`116937ca-25ba-4509-a55f-6d7db70d8690`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:58:58,370::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:58:58,372::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:58:58,373::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`116937ca-25ba-4509-a55f-6d7db70d8690`::Granted request
>Thread-15::DEBUG::2014-08-21 10:58:58,375::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00122587 s, 406 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:58:58,377::task::827::TaskManager.Task::(resourceAcquired) Task=`88ce901b-5ad2-4714-b69f-ee371cc6e2ca`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:58:58,380::task::990::TaskManager.Task::(_decref) Task=`88ce901b-5ad2-4714-b69f-ee371cc6e2ca`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:58:58,400::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:58,400::task::1185::TaskManager.Task::(prepare) Task=`88ce901b-5ad2-4714-b69f-ee371cc6e2ca`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:58:58,400::task::595::TaskManager.Task::(_updateState) Task=`88ce901b-5ad2-4714-b69f-ee371cc6e2ca`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:58:58,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:58:58,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:58:58,401::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:58:58,402::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:58:58,402::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:58:58,402::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:58:58,402::task::990::TaskManager.Task::(_decref) Task=`88ce901b-5ad2-4714-b69f-ee371cc6e2ca`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:58:59,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:58:59,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0608891 s, 16.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:01,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:01,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0716161 s, 14.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:03,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:05,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.51622 s, 675 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:59:09,889::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-26::DEBUG::2014-08-21 10:59:09,906::task::595::TaskManager.Task::(_updateState) Task=`ae0ecef1-f84d-4904-9979-2c96ce97d557`::moving from state init -> state preparing
>Dummy-33::DEBUG::2014-08-21 10:59:09,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::INFO::2014-08-21 10:59:09,918::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:59:10,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:10,111::task::1185::TaskManager.Task::(prepare) Task=`ae0ecef1-f84d-4904-9979-2c96ce97d557`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:10,123::task::595::TaskManager.Task::(_updateState) Task=`ae0ecef1-f84d-4904-9979-2c96ce97d557`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:59:10,132::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:59:10,141::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:59:10,149::task::990::TaskManager.Task::(_decref) Task=`ae0ecef1-f84d-4904-9979-2c96ce97d557`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:59:10,192::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-34::DEBUG::2014-08-21 10:59:10,202::task::595::TaskManager.Task::(_updateState) Task=`630c8b58-00e6-4200-a33a-9b437403071f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:59:10,209::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:59:10,222::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e4a55f04-64e5-4df8-9514-c6c9b93b82ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:59:10,225::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:59:10,231::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:59:10,233::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e4a55f04-64e5-4df8-9514-c6c9b93b82ee`::Granted request
>Thread-34::DEBUG::2014-08-21 10:59:10,240::task::827::TaskManager.Task::(resourceAcquired) Task=`630c8b58-00e6-4200-a33a-9b437403071f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:59:10,243::task::990::TaskManager.Task::(_decref) Task=`630c8b58-00e6-4200-a33a-9b437403071f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:59:10,355::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:10,360::task::1185::TaskManager.Task::(prepare) Task=`630c8b58-00e6-4200-a33a-9b437403071f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:10,364::task::595::TaskManager.Task::(_updateState) Task=`630c8b58-00e6-4200-a33a-9b437403071f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:59:10,368::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:59:10,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:59:10,380::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:59:10,387::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:59:10,389::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:59:10,391::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:59:10,396::task::990::TaskManager.Task::(_decref) Task=`630c8b58-00e6-4200-a33a-9b437403071f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:59:10,412::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:59:10,478::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.012713 s, 39.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:10,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.69647 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:12,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:59:12,947::task::595::TaskManager.Task::(_updateState) Task=`96dc0211-a082-4e1f-aa86-b935aadb7446`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:59:12,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:59:12,952::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.012713', 'lastCheck': '2.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:59:12,954::task::1185::TaskManager.Task::(prepare) Task=`96dc0211-a082-4e1f-aa86-b935aadb7446`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.012713', 'lastCheck': '2.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:59:12,956::task::595::TaskManager.Task::(_updateState) Task=`96dc0211-a082-4e1f-aa86-b935aadb7446`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:59:12,958::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:59:12,959::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:59:12,961::task::990::TaskManager.Task::(_decref) Task=`96dc0211-a082-4e1f-aa86-b935aadb7446`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:59:13,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869957 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:15,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:16,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.2437 s, 823 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:18,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:18,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0688275 s, 14.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:59:20,440::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [69bf064]
>Thread-26::DEBUG::2014-08-21 10:59:20,443::task::595::TaskManager.Task::(_updateState) Task=`a8753d43-4d5b-49b9-985e-05597255b26e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:59:20,443::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:59:20,444::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:20,444::task::1185::TaskManager.Task::(prepare) Task=`a8753d43-4d5b-49b9-985e-05597255b26e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:20,445::task::595::TaskManager.Task::(_updateState) Task=`a8753d43-4d5b-49b9-985e-05597255b26e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:59:20,445::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:59:20,445::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:59:20,445::task::990::TaskManager.Task::(_decref) Task=`a8753d43-4d5b-49b9-985e-05597255b26e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:59:20,454::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [69bf064]
>Thread-34::DEBUG::2014-08-21 10:59:20,455::task::595::TaskManager.Task::(_updateState) Task=`ff125e57-279b-44da-beb1-b3a694e8a7d6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:59:20,456::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:59:20,457::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d34b80f5-333d-4d22-9380-a9531fce946e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:59:20,457::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:59:20,458::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:59:20,458::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d34b80f5-333d-4d22-9380-a9531fce946e`::Granted request
>Thread-34::DEBUG::2014-08-21 10:59:20,459::task::827::TaskManager.Task::(resourceAcquired) Task=`ff125e57-279b-44da-beb1-b3a694e8a7d6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:59:20,459::task::990::TaskManager.Task::(_decref) Task=`ff125e57-279b-44da-beb1-b3a694e8a7d6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:59:20,464::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:20,464::task::1185::TaskManager.Task::(prepare) Task=`ff125e57-279b-44da-beb1-b3a694e8a7d6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:20,464::task::595::TaskManager.Task::(_updateState) Task=`ff125e57-279b-44da-beb1-b3a694e8a7d6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:59:20,465::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:59:20,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:59:20,465::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:59:20,466::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:59:20,466::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:59:20,466::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:59:20,466::task::990::TaskManager.Task::(_decref) Task=`ff125e57-279b-44da-beb1-b3a694e8a7d6`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:59:20,522::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:59:20,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00221375 s, 225 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:20,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:20,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.130812 s, 7.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:22,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:23,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.238268 s, 4.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:25,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:25,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116301 s, 8.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:27,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:27,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.14008 s, 7.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:59:28,218::task::595::TaskManager.Task::(_updateState) Task=`d0dd603c-55e7-42e8-9210-972989a19d67`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:59:28,219::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:59:28,219::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221375', 'lastCheck': '7.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:59:28,219::task::1185::TaskManager.Task::(prepare) Task=`d0dd603c-55e7-42e8-9210-972989a19d67`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221375', 'lastCheck': '7.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:59:28,219::task::595::TaskManager.Task::(_updateState) Task=`d0dd603c-55e7-42e8-9210-972989a19d67`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:59:28,220::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:59:28,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:59:28,220::task::990::TaskManager.Task::(_decref) Task=`d0dd603c-55e7-42e8-9210-972989a19d67`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:59:29,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:29,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897082 s, 11.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:59:30,492::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-26::DEBUG::2014-08-21 10:59:30,493::task::595::TaskManager.Task::(_updateState) Task=`fcbd4647-8af4-4f34-85f9-9838af5c88fe`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:59:30,494::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:59:30,494::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:30,494::task::1185::TaskManager.Task::(prepare) Task=`fcbd4647-8af4-4f34-85f9-9838af5c88fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:30,495::task::595::TaskManager.Task::(_updateState) Task=`fcbd4647-8af4-4f34-85f9-9838af5c88fe`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:59:30,495::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:59:30,495::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:59:30,495::task::990::TaskManager.Task::(_decref) Task=`fcbd4647-8af4-4f34-85f9-9838af5c88fe`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:59:30,500::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-34::DEBUG::2014-08-21 10:59:30,500::task::595::TaskManager.Task::(_updateState) Task=`63645c67-83b8-4ffd-b4ad-94c72ec00995`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:59:30,501::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:59:30,501::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9bec99e0-d94c-45a7-aa88-cfa6350b18a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:59:30,502::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:59:30,502::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:59:30,502::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9bec99e0-d94c-45a7-aa88-cfa6350b18a8`::Granted request
>Thread-34::DEBUG::2014-08-21 10:59:30,503::task::827::TaskManager.Task::(resourceAcquired) Task=`63645c67-83b8-4ffd-b4ad-94c72ec00995`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:59:30,503::task::990::TaskManager.Task::(_decref) Task=`63645c67-83b8-4ffd-b4ad-94c72ec00995`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:59:30,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:30,507::task::1185::TaskManager.Task::(prepare) Task=`63645c67-83b8-4ffd-b4ad-94c72ec00995`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895932928', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:30,507::task::595::TaskManager.Task::(_updateState) Task=`63645c67-83b8-4ffd-b4ad-94c72ec00995`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:59:30,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:59:30,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:59:30,508::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:59:30,508::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:59:30,508::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:59:30,509::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:59:30,509::task::990::TaskManager.Task::(_decref) Task=`63645c67-83b8-4ffd-b4ad-94c72ec00995`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:59:30,557::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:59:30,577::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000555794 s, 896 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:31,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:32,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.306718 s, 3.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:34,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:35,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.522503 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:37,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:37,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10258 s, 10.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:39,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:39,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436942 s, 23.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 10:59:40,528::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-26::DEBUG::2014-08-21 10:59:40,530::task::595::TaskManager.Task::(_updateState) Task=`44d97ba5-915f-40ce-a038-40a3f30af146`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:59:40,530::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:59:40,531::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:40,531::task::1185::TaskManager.Task::(prepare) Task=`44d97ba5-915f-40ce-a038-40a3f30af146`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:40,532::task::595::TaskManager.Task::(_updateState) Task=`44d97ba5-915f-40ce-a038-40a3f30af146`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:59:40,532::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:59:40,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:59:40,533::task::990::TaskManager.Task::(_decref) Task=`44d97ba5-915f-40ce-a038-40a3f30af146`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:59:40,540::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-34::DEBUG::2014-08-21 10:59:40,541::task::595::TaskManager.Task::(_updateState) Task=`09df29f1-4793-4e2d-98a7-b8929819da6c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:59:40,541::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 10:59:40,542::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6750bf66-756a-4126-bc8d-a03ef263ac74`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:59:40,542::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:59:40,543::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:59:40,543::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6750bf66-756a-4126-bc8d-a03ef263ac74`::Granted request
>Thread-34::DEBUG::2014-08-21 10:59:40,543::task::827::TaskManager.Task::(resourceAcquired) Task=`09df29f1-4793-4e2d-98a7-b8929819da6c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 10:59:40,544::task::990::TaskManager.Task::(_decref) Task=`09df29f1-4793-4e2d-98a7-b8929819da6c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:59:40,548::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:40,548::task::1185::TaskManager.Task::(prepare) Task=`09df29f1-4793-4e2d-98a7-b8929819da6c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:40,549::task::595::TaskManager.Task::(_updateState) Task=`09df29f1-4793-4e2d-98a7-b8929819da6c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:59:40,549::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:59:40,549::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:59:40,549::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:59:40,550::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:59:40,550::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:59:40,550::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:59:40,550::task::990::TaskManager.Task::(_decref) Task=`09df29f1-4793-4e2d-98a7-b8929819da6c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 10:59:40,600::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 10:59:40,614::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000437018 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:42,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:59:44,070::task::595::TaskManager.Task::(_updateState) Task=`46bbaa80-7cc6-4e58-8e85-8ae647845a25`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:59:44,071::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 10:59:44,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437018', 'lastCheck': '3.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:59:44,072::task::1185::TaskManager.Task::(prepare) Task=`46bbaa80-7cc6-4e58-8e85-8ae647845a25`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437018', 'lastCheck': '3.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 10:59:44,072::task::595::TaskManager.Task::(_updateState) Task=`46bbaa80-7cc6-4e58-8e85-8ae647845a25`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:59:44,099::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:59:44,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:59:44,100::task::990::TaskManager.Task::(_decref) Task=`46bbaa80-7cc6-4e58-8e85-8ae647845a25`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:59:45,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.06143 s, 334 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:47,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 10:59:47,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0859741 s, 11.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 10:59:52,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 10:59:54,115::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [69bf064]
>Thread-26::DEBUG::2014-08-21 10:59:54,649::task::595::TaskManager.Task::(_updateState) Task=`e6e8d7bb-8570-4f76-8a99-78c691ea509e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 10:59:54,650::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 10:59:54,811::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:54,817::task::1185::TaskManager.Task::(prepare) Task=`e6e8d7bb-8570-4f76-8a99-78c691ea509e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 10:59:54,827::task::595::TaskManager.Task::(_updateState) Task=`e6e8d7bb-8570-4f76-8a99-78c691ea509e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 10:59:54,827::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 10:59:54,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 10:59:54,877::task::990::TaskManager.Task::(_decref) Task=`e6e8d7bb-8570-4f76-8a99-78c691ea509e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 10:59:57,956::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [69bf064]
>Thread-34::DEBUG::2014-08-21 10:59:58,059::task::595::TaskManager.Task::(_updateState) Task=`5fc828b8-25e3-406a-91b9-57c063c1ade3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 10:59:58,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 10:59:58,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 10:59:59,227::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`26b85cd1-6266-43ce-af14-70e9178d8c1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 10:59:59,278::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 10:59:59,305::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 10:59:59,316::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`26b85cd1-6266-43ce-af14-70e9178d8c1c`::Granted request
>Thread-34::DEBUG::2014-08-21 10:59:59,332::task::827::TaskManager.Task::(resourceAcquired) Task=`5fc828b8-25e3-406a-91b9-57c063c1ade3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-15::DEBUG::2014-08-21 10:59:59,334::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000479343 s, 1.0 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 10:59:59,340::task::990::TaskManager.Task::(_decref) Task=`5fc828b8-25e3-406a-91b9-57c063c1ade3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 10:59:59,470::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:59,503::task::1185::TaskManager.Task::(prepare) Task=`5fc828b8-25e3-406a-91b9-57c063c1ade3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 10:59:59,518::task::595::TaskManager.Task::(_updateState) Task=`5fc828b8-25e3-406a-91b9-57c063c1ade3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 10:59:59,519::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 10:59:59,535::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 10:59:59,577::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 10:59:59,580::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 10:59:59,594::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 10:59:59,597::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 10:59:59,610::task::990::TaskManager.Task::(_decref) Task=`5fc828b8-25e3-406a-91b9-57c063c1ade3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 10:59:59,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.85436 s, 175 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:02,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:03,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.923635 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:00:07,395::task::595::TaskManager.Task::(_updateState) Task=`05963cc7-8f7f-4acc-9087-69d6c73793ab`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:00:07,421::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:00:07,421::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479343', 'lastCheck': '8.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:00:07,422::task::1185::TaskManager.Task::(prepare) Task=`05963cc7-8f7f-4acc-9087-69d6c73793ab`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479343', 'lastCheck': '8.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:00:07,422::task::595::TaskManager.Task::(_updateState) Task=`05963cc7-8f7f-4acc-9087-69d6c73793ab`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:00:07,422::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:00:07,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:00:07,423::task::990::TaskManager.Task::(_decref) Task=`05963cc7-8f7f-4acc-9087-69d6c73793ab`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:00:07,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:07,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116309 s, 8.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:00:09,408::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:00:09,428::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000855831 s, 582 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:00:09,685::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-13::DEBUG::2014-08-21 11:00:09,687::task::595::TaskManager.Task::(_updateState) Task=`058c23f1-67cb-4c77-a275-f0a2c83d70c1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:00:09,688::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:00:09,689::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:00:09,690::task::1185::TaskManager.Task::(prepare) Task=`058c23f1-67cb-4c77-a275-f0a2c83d70c1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:00:09,694::task::595::TaskManager.Task::(_updateState) Task=`058c23f1-67cb-4c77-a275-f0a2c83d70c1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:00:09,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:00:09,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:00:09,700::task::990::TaskManager.Task::(_decref) Task=`058c23f1-67cb-4c77-a275-f0a2c83d70c1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:00:09,715::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-34::DEBUG::2014-08-21 11:00:09,720::task::595::TaskManager.Task::(_updateState) Task=`a9274125-1a38-4d8a-aeb3-ce4ded536cd5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:00:09,722::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 11:00:09,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:00:09,728::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`395365e4-6c00-4634-b90a-df8713e59741`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:00:09,730::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:00:09,748::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:00:09,752::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`395365e4-6c00-4634-b90a-df8713e59741`::Granted request
>Thread-34::DEBUG::2014-08-21 11:00:09,758::task::827::TaskManager.Task::(resourceAcquired) Task=`a9274125-1a38-4d8a-aeb3-ce4ded536cd5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:00:09,761::task::990::TaskManager.Task::(_decref) Task=`a9274125-1a38-4d8a-aeb3-ce4ded536cd5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:00:09,826::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:00:09,831::task::1185::TaskManager.Task::(prepare) Task=`a9274125-1a38-4d8a-aeb3-ce4ded536cd5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:00:09,834::task::595::TaskManager.Task::(_updateState) Task=`a9274125-1a38-4d8a-aeb3-ce4ded536cd5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:00:09,836::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:00:09,838::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:00:09,842::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:00:09,844::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:00:09,850::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:00:09,856::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:00:09,859::task::990::TaskManager.Task::(_decref) Task=`a9274125-1a38-4d8a-aeb3-ce4ded536cd5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:00:10,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.291189 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:12,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:12,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.211913 s, 4.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:14,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:15,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0581139 s, 17.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:17,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:17,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0731544 s, 14.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:21,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:00:22,200::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-26::DEBUG::2014-08-21 11:00:22,232::task::595::TaskManager.Task::(_updateState) Task=`cac4dbc3-6dc2-4e8e-b0eb-05dec9f05af8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:00:22,248::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:00:22,262::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:00:22,269::task::1185::TaskManager.Task::(prepare) Task=`cac4dbc3-6dc2-4e8e-b0eb-05dec9f05af8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:00:22,270::task::595::TaskManager.Task::(_updateState) Task=`cac4dbc3-6dc2-4e8e-b0eb-05dec9f05af8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:00:22,287::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:00:22,301::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:00:22,317::task::990::TaskManager.Task::(_decref) Task=`cac4dbc3-6dc2-4e8e-b0eb-05dec9f05af8`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:00:28,684::task::595::TaskManager.Task::(_updateState) Task=`c1bcd1d5-521e-4361-a3eb-094d177fd86b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:00:28,722::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:00:28,723::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000855831', 'lastCheck': '19.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:00:28,723::task::1185::TaskManager.Task::(prepare) Task=`c1bcd1d5-521e-4361-a3eb-094d177fd86b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000855831', 'lastCheck': '19.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:00:28,724::task::595::TaskManager.Task::(_updateState) Task=`c1bcd1d5-521e-4361-a3eb-094d177fd86b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:00:28,724::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:00:28,724::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:00:28,724::task::990::TaskManager.Task::(_decref) Task=`c1bcd1d5-521e-4361-a3eb-094d177fd86b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:00:28,765::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-34::DEBUG::2014-08-21 11:00:28,983::task::595::TaskManager.Task::(_updateState) Task=`e1c472a0-15cf-4e1f-8bc2-ec5ed8ecc5fd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:00:28,992::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:00:29,015::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5c913a80-9412-4eb6-a2d2-c4f60abf2c5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:00:29,023::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:00:29,029::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:00:29,032::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5c913a80-9412-4eb6-a2d2-c4f60abf2c5e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:00:29,040::task::827::TaskManager.Task::(resourceAcquired) Task=`e1c472a0-15cf-4e1f-8bc2-ec5ed8ecc5fd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:00:29,043::task::990::TaskManager.Task::(_decref) Task=`e1c472a0-15cf-4e1f-8bc2-ec5ed8ecc5fd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:00:29,112::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:00:29,115::task::1185::TaskManager.Task::(prepare) Task=`e1c472a0-15cf-4e1f-8bc2-ec5ed8ecc5fd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:00:29,118::task::595::TaskManager.Task::(_updateState) Task=`e1c472a0-15cf-4e1f-8bc2-ec5ed8ecc5fd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:00:29,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:00:29,127::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:00:29,134::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:00:29,145::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:00:29,146::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:00:29,146::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:00:29,147::task::990::TaskManager.Task::(_decref) Task=`e1c472a0-15cf-4e1f-8bc2-ec5ed8ecc5fd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:00:29,177::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:00:29,305::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000548023 s, 909 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:29,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.20683 s, 142 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:31,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:31,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0739856 s, 13.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:33,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:33,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.164571 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:35,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:36,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.172952 s, 5.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:38,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:38,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170601 s, 6.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:00:39,496::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-13::DEBUG::2014-08-21 11:00:39,498::task::595::TaskManager.Task::(_updateState) Task=`a61ac0ce-6352-4981-84be-c8a115da596f`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 11:00:39,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::INFO::2014-08-21 11:00:40,003::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:00:40,160::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:00:40,166::task::1185::TaskManager.Task::(prepare) Task=`a61ac0ce-6352-4981-84be-c8a115da596f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:00:40,180::task::595::TaskManager.Task::(_updateState) Task=`a61ac0ce-6352-4981-84be-c8a115da596f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:00:40,186::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:00:40,207::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:00:40,244::task::990::TaskManager.Task::(_decref) Task=`a61ac0ce-6352-4981-84be-c8a115da596f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:00:40,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.024237 s, 20.5 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:00:40,398::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-34::DEBUG::2014-08-21 11:00:40,433::task::595::TaskManager.Task::(_updateState) Task=`0d836d0b-a7c2-4747-9805-4f23e346af78`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:00:40,437::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:00:40,445::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`712b6907-c551-4b2f-9737-60b9bb98fd2f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:00:40,448::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:00:40,454::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:00:40,457::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`712b6907-c551-4b2f-9737-60b9bb98fd2f`::Granted request
>Thread-34::DEBUG::2014-08-21 11:00:40,460::task::827::TaskManager.Task::(resourceAcquired) Task=`0d836d0b-a7c2-4747-9805-4f23e346af78`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:00:40,461::task::990::TaskManager.Task::(_decref) Task=`0d836d0b-a7c2-4747-9805-4f23e346af78`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:00:40,493::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:00:40,495::task::1185::TaskManager.Task::(prepare) Task=`0d836d0b-a7c2-4747-9805-4f23e346af78`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:00:40,496::task::595::TaskManager.Task::(_updateState) Task=`0d836d0b-a7c2-4747-9805-4f23e346af78`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:00:40,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:00:40,499::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:00:40,501::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:00:40,503::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:00:40,504::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:00:40,504::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:00:40,506::task::990::TaskManager.Task::(_decref) Task=`0d836d0b-a7c2-4747-9805-4f23e346af78`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:00:41,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:41,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.237266 s, 4.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:43,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:44,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448285 s, 22.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:00:44,837::task::595::TaskManager.Task::(_updateState) Task=`54cec047-5835-4351-add8-299fade57fa8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:00:44,838::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:00:44,838::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.024237', 'lastCheck': '4.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:00:44,838::task::1185::TaskManager.Task::(prepare) Task=`54cec047-5835-4351-add8-299fade57fa8`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.024237', 'lastCheck': '4.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:00:44,839::task::595::TaskManager.Task::(_updateState) Task=`54cec047-5835-4351-add8-299fade57fa8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:00:44,839::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:00:44,839::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:00:44,840::task::990::TaskManager.Task::(_decref) Task=`54cec047-5835-4351-add8-299fade57fa8`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:00:46,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:46,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552223 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:48,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:48,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.23339 s, 4.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:00:50,479::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:00:50,783::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-15::DEBUG::2014-08-21 11:00:51,065::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.021947 s, 22.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:51,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:00:51,114::task::595::TaskManager.Task::(_updateState) Task=`d35c7ed1-ef04-4331-9196-4f8338e327b5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:00:51,115::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:00:51,116::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:00:51,117::task::1185::TaskManager.Task::(prepare) Task=`d35c7ed1-ef04-4331-9196-4f8338e327b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:00:51,117::task::595::TaskManager.Task::(_updateState) Task=`d35c7ed1-ef04-4331-9196-4f8338e327b5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:00:51,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:00:51,120::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:00:51,155::task::990::TaskManager.Task::(_decref) Task=`d35c7ed1-ef04-4331-9196-4f8338e327b5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:00:51,178::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-34::DEBUG::2014-08-21 11:00:51,182::task::595::TaskManager.Task::(_updateState) Task=`7ec79322-788d-47f9-8717-1f99329425b7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:00:51,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:00:51,188::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5c8a545e-63ea-4ea0-bb0d-4c8e0d9291df`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:00:51,189::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:00:51,191::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:00:51,192::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5c8a545e-63ea-4ea0-bb0d-4c8e0d9291df`::Granted request
>Thread-34::DEBUG::2014-08-21 11:00:51,196::task::827::TaskManager.Task::(resourceAcquired) Task=`7ec79322-788d-47f9-8717-1f99329425b7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:00:51,198::task::990::TaskManager.Task::(_decref) Task=`7ec79322-788d-47f9-8717-1f99329425b7`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:00:51,221::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:00:51,223::task::1185::TaskManager.Task::(prepare) Task=`7ec79322-788d-47f9-8717-1f99329425b7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:00:51,224::task::595::TaskManager.Task::(_updateState) Task=`7ec79322-788d-47f9-8717-1f99329425b7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:00:51,225::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:00:51,226::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:00:51,228::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:00:51,230::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:00:51,231::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:00:51,232::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:00:51,234::task::990::TaskManager.Task::(_decref) Task=`7ec79322-788d-47f9-8717-1f99329425b7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:00:51,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.276141 s, 3.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:53,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:53,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0614941 s, 16.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:55,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:55,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0763274 s, 13.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:00:57,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:00:58,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105013 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:01:00,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:01:00,223::task::595::TaskManager.Task::(_updateState) Task=`296a19e2-a744-4fef-bb8c-a496260c43db`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:01:00,227::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:01:00,230::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.021947', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:01:00,231::task::1185::TaskManager.Task::(prepare) Task=`296a19e2-a744-4fef-bb8c-a496260c43db`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.021947', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:01:00,232::task::595::TaskManager.Task::(_updateState) Task=`296a19e2-a744-4fef-bb8c-a496260c43db`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:01:00,234::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:01:00,235::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:01:00,236::task::990::TaskManager.Task::(_decref) Task=`296a19e2-a744-4fef-bb8c-a496260c43db`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:01:00,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0801072 s, 12.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:01:01,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:01:01,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0013505 s, 369 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:01:01,424::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-13::DEBUG::2014-08-21 11:01:01,428::task::595::TaskManager.Task::(_updateState) Task=`351b838e-bdf4-4dd5-9a46-bb55ac15c2d2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:01:01,429::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:01:01,431::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:01:01,432::task::1185::TaskManager.Task::(prepare) Task=`351b838e-bdf4-4dd5-9a46-bb55ac15c2d2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:01:01,432::task::595::TaskManager.Task::(_updateState) Task=`351b838e-bdf4-4dd5-9a46-bb55ac15c2d2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:01:01,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:01:01,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:01:01,435::task::990::TaskManager.Task::(_decref) Task=`351b838e-bdf4-4dd5-9a46-bb55ac15c2d2`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:01:01,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 11:01:01,455::task::595::TaskManager.Task::(_updateState) Task=`26d21097-0df9-42df-beb7-c78bf735aa8e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:01:01,457::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:01:01,461::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7805ec0c-c6cc-4937-8455-b01612b9a4ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:01:01,462::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:01:01,464::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:01:01,466::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7805ec0c-c6cc-4937-8455-b01612b9a4ac`::Granted request
>Thread-34::DEBUG::2014-08-21 11:01:01,468::task::827::TaskManager.Task::(resourceAcquired) Task=`26d21097-0df9-42df-beb7-c78bf735aa8e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:01:01,469::task::990::TaskManager.Task::(_decref) Task=`26d21097-0df9-42df-beb7-c78bf735aa8e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:01:01,490::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:01:01,492::task::1185::TaskManager.Task::(prepare) Task=`26d21097-0df9-42df-beb7-c78bf735aa8e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:01:01,494::task::595::TaskManager.Task::(_updateState) Task=`26d21097-0df9-42df-beb7-c78bf735aa8e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:01:01,495::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:01:01,496::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:01:01,498::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:01:01,500::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:01:01,501::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:01:01,502::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:01:01,505::task::990::TaskManager.Task::(_decref) Task=`26d21097-0df9-42df-beb7-c78bf735aa8e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:01:02,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:01:02,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.342522 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:01:05,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:01:10,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.93884 s, 260 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:01:11,539::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-13::DEBUG::2014-08-21 11:01:11,542::task::595::TaskManager.Task::(_updateState) Task=`09f3db88-4418-4b42-8ebf-3f4e20cc2d26`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:01:11,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:01:11,545::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:01:11,554::task::1185::TaskManager.Task::(prepare) Task=`09f3db88-4418-4b42-8ebf-3f4e20cc2d26`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:01:11,555::task::595::TaskManager.Task::(_updateState) Task=`09f3db88-4418-4b42-8ebf-3f4e20cc2d26`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:01:11,555::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:01:11,631::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:01:11,633::task::990::TaskManager.Task::(_decref) Task=`09f3db88-4418-4b42-8ebf-3f4e20cc2d26`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:01:11,640::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-34::DEBUG::2014-08-21 11:01:11,641::task::595::TaskManager.Task::(_updateState) Task=`17e0c885-1247-4618-ae10-83ffb4d40181`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:01:11,641::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:01:11,642::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5aa43eb6-83f6-4a82-933c-9bb3308225ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:01:11,643::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:01:11,643::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:01:11,644::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5aa43eb6-83f6-4a82-933c-9bb3308225ed`::Granted request
>Thread-34::DEBUG::2014-08-21 11:01:11,668::task::827::TaskManager.Task::(resourceAcquired) Task=`17e0c885-1247-4618-ae10-83ffb4d40181`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:01:11,671::task::990::TaskManager.Task::(_decref) Task=`17e0c885-1247-4618-ae10-83ffb4d40181`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:01:11,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:01:11,787::task::1185::TaskManager.Task::(prepare) Task=`17e0c885-1247-4618-ae10-83ffb4d40181`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:01:11,787::task::595::TaskManager.Task::(_updateState) Task=`17e0c885-1247-4618-ae10-83ffb4d40181`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:01:11,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:01:11,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:01:11,789::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:01:11,789::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:01:11,838::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:01:11,838::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:01:11,839::task::990::TaskManager.Task::(_decref) Task=`17e0c885-1247-4618-ae10-83ffb4d40181`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:01:37,876::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2d92e2f2]
>Dummy-33::DEBUG::2014-08-21 11:01:37,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:01:37,899::task::595::TaskManager.Task::(_updateState) Task=`4da0ed72-f3e5-45fa-a8d2-3e5b94744fb7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:02:02,219::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:02:02,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:02:02,234::task::1185::TaskManager.Task::(prepare) Task=`4da0ed72-f3e5-45fa-a8d2-3e5b94744fb7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:02:02,235::task::595::TaskManager.Task::(_updateState) Task=`03b939e0-66d4-4e76-b9c3-70e3cb8e450c`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 11:02:02,336::task::595::TaskManager.Task::(_updateState) Task=`4da0ed72-f3e5-45fa-a8d2-3e5b94744fb7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:02:02,452::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:02:02,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:02:02,452::task::990::TaskManager.Task::(_decref) Task=`4da0ed72-f3e5-45fa-a8d2-3e5b94744fb7`::ref 0 aborting False
>Thread-13::INFO::2014-08-21 11:02:02,385::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:02:02,453::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0013505', 'lastCheck': '61.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:02:02,454::task::1185::TaskManager.Task::(prepare) Task=`03b939e0-66d4-4e76-b9c3-70e3cb8e450c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0013505', 'lastCheck': '61.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:02:02,454::task::595::TaskManager.Task::(_updateState) Task=`03b939e0-66d4-4e76-b9c3-70e3cb8e450c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:02:02,454::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:02:02,454::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:02:02,455::task::990::TaskManager.Task::(_decref) Task=`03b939e0-66d4-4e76-b9c3-70e3cb8e450c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:02:02,451::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:02:02,919::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0142493 s, 34.9 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:02:03,299::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2d92e2f2]
>Thread-34::DEBUG::2014-08-21 11:02:03,301::task::595::TaskManager.Task::(_updateState) Task=`38f4bb13-25e8-44be-b948-906e09762f82`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:02:03,302::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:02:03,312::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15f93711-a1ef-4896-8416-bdc816f0331c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:02:03,313::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:02:03,314::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:02:03,315::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15f93711-a1ef-4896-8416-bdc816f0331c`::Granted request
>Thread-34::DEBUG::2014-08-21 11:02:03,316::task::827::TaskManager.Task::(resourceAcquired) Task=`38f4bb13-25e8-44be-b948-906e09762f82`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:02:03,333::task::990::TaskManager.Task::(_decref) Task=`38f4bb13-25e8-44be-b948-906e09762f82`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:02:03,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:03,411::task::1185::TaskManager.Task::(prepare) Task=`38f4bb13-25e8-44be-b948-906e09762f82`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:03,411::task::595::TaskManager.Task::(_updateState) Task=`38f4bb13-25e8-44be-b948-906e09762f82`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:02:03,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:02:03,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:02:03,413::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:02:03,430::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:02:03,431::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:02:03,431::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:02:03,432::task::990::TaskManager.Task::(_decref) Task=`38f4bb13-25e8-44be-b948-906e09762f82`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:02:04,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.74248 s, 588 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:07,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:08,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0946907 s, 10.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:10,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:10,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.147252 s, 7.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:12,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:12,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.469816 s, 2.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:02:13,882::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-13::DEBUG::2014-08-21 11:02:13,886::task::595::TaskManager.Task::(_updateState) Task=`120d9af3-5c02-4e0c-a4cd-6790784ca0d0`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:02:13,886::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:02:13,887::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:02:13,887::task::1185::TaskManager.Task::(prepare) Task=`120d9af3-5c02-4e0c-a4cd-6790784ca0d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:02:13,888::task::595::TaskManager.Task::(_updateState) Task=`120d9af3-5c02-4e0c-a4cd-6790784ca0d0`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:02:13,888::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:02:13,888::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:02:13,889::task::990::TaskManager.Task::(_decref) Task=`120d9af3-5c02-4e0c-a4cd-6790784ca0d0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:02:13,895::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-34::DEBUG::2014-08-21 11:02:13,896::task::595::TaskManager.Task::(_updateState) Task=`80266e2d-0b88-492c-ae6a-0c42842d4efa`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:02:13,897::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:02:13,898::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1218a48-f070-4db7-96e7-f5bfecb554c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:02:13,899::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:02:13,899::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:02:13,900::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1218a48-f070-4db7-96e7-f5bfecb554c9`::Granted request
>Thread-34::DEBUG::2014-08-21 11:02:13,900::task::827::TaskManager.Task::(resourceAcquired) Task=`80266e2d-0b88-492c-ae6a-0c42842d4efa`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:02:13,901::task::990::TaskManager.Task::(_decref) Task=`80266e2d-0b88-492c-ae6a-0c42842d4efa`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:02:13,908::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:13,908::task::1185::TaskManager.Task::(prepare) Task=`80266e2d-0b88-492c-ae6a-0c42842d4efa`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:13,909::task::595::TaskManager.Task::(_updateState) Task=`80266e2d-0b88-492c-ae6a-0c42842d4efa`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:02:13,909::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:02:13,910::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:02:13,910::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:02:13,911::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:02:13,911::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:02:13,911::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:02:13,911::task::990::TaskManager.Task::(_decref) Task=`80266e2d-0b88-492c-ae6a-0c42842d4efa`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:02:13,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:02:13,964::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000514058 s, 969 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:14,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:15,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0643053 s, 15.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:17,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:17,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.169786 s, 6.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:02:18,742::task::595::TaskManager.Task::(_updateState) Task=`5eb301a3-7752-47bf-91b7-d75b741b002d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:02:18,743::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:02:18,743::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514058', 'lastCheck': '4.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:02:18,743::task::1185::TaskManager.Task::(prepare) Task=`5eb301a3-7752-47bf-91b7-d75b741b002d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514058', 'lastCheck': '4.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:02:18,744::task::595::TaskManager.Task::(_updateState) Task=`5eb301a3-7752-47bf-91b7-d75b741b002d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:02:18,744::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:02:18,744::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:02:18,744::task::990::TaskManager.Task::(_decref) Task=`5eb301a3-7752-47bf-91b7-d75b741b002d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:02:19,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:20,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.146922 s, 7.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:22,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:22,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.212174 s, 4.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:02:24,054::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-13::DEBUG::2014-08-21 11:02:24,056::task::595::TaskManager.Task::(_updateState) Task=`18fd57fc-dfe8-47e7-80b6-b2872fcfc293`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:02:24,097::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:02:24,099::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:02:24,099::task::1185::TaskManager.Task::(prepare) Task=`18fd57fc-dfe8-47e7-80b6-b2872fcfc293`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:02:24,099::task::595::TaskManager.Task::(_updateState) Task=`18fd57fc-dfe8-47e7-80b6-b2872fcfc293`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:02:24,127::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:02:24,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:02:24,178::task::990::TaskManager.Task::(_decref) Task=`18fd57fc-dfe8-47e7-80b6-b2872fcfc293`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:02:24,280::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 11:02:24,281::task::595::TaskManager.Task::(_updateState) Task=`4bbe7629-53f9-40cd-bd8a-2626854674d5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:02:24,281::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:02:24,282::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`56d262ac-9e12-426a-8e33-843b95d0aaca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:02:24,284::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:02:24,285::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:02:24,285::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`56d262ac-9e12-426a-8e33-843b95d0aaca`::Granted request
>Thread-34::DEBUG::2014-08-21 11:02:24,286::task::827::TaskManager.Task::(resourceAcquired) Task=`4bbe7629-53f9-40cd-bd8a-2626854674d5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:02:24,287::task::990::TaskManager.Task::(_decref) Task=`4bbe7629-53f9-40cd-bd8a-2626854674d5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:02:24,293::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:24,303::task::1185::TaskManager.Task::(prepare) Task=`4bbe7629-53f9-40cd-bd8a-2626854674d5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896195072', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:24,305::task::595::TaskManager.Task::(_updateState) Task=`4bbe7629-53f9-40cd-bd8a-2626854674d5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:02:24,305::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:02:24,306::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:02:24,334::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:02:24,335::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:02:24,335::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:02:24,335::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:02:24,336::task::990::TaskManager.Task::(_decref) Task=`4bbe7629-53f9-40cd-bd8a-2626854674d5`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:02:24,372::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:02:24,487::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0504421 s, 9.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:26,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:26,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.576285 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:29,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:29,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.159756 s, 6.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:31,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:02:34,431::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-26::DEBUG::2014-08-21 11:02:34,437::task::595::TaskManager.Task::(_updateState) Task=`3c343836-a973-4eb6-a674-bfc81c05a1a5`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:02:34,439::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:02:34,440::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:02:34,440::task::1185::TaskManager.Task::(prepare) Task=`3c343836-a973-4eb6-a674-bfc81c05a1a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:02:34,440::task::595::TaskManager.Task::(_updateState) Task=`3c343836-a973-4eb6-a674-bfc81c05a1a5`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:02:34,441::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:02:34,441::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:02:34,442::task::990::TaskManager.Task::(_decref) Task=`3c343836-a973-4eb6-a674-bfc81c05a1a5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:02:34,513::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 11:02:34,515::task::595::TaskManager.Task::(_updateState) Task=`4e3eef40-5956-4506-8125-4b6c1b01a005`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:02:34,515::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:02:34,517::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`36582f28-c9c4-4cd0-822d-618467dd7ec9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:02:34,517::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:02:34,518::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:02:34,519::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`36582f28-c9c4-4cd0-822d-618467dd7ec9`::Granted request
>Thread-34::DEBUG::2014-08-21 11:02:34,520::task::827::TaskManager.Task::(resourceAcquired) Task=`4e3eef40-5956-4506-8125-4b6c1b01a005`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:02:34,521::task::990::TaskManager.Task::(_decref) Task=`4e3eef40-5956-4506-8125-4b6c1b01a005`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:02:35,652::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:35,652::task::1185::TaskManager.Task::(prepare) Task=`4e3eef40-5956-4506-8125-4b6c1b01a005`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:35,653::task::595::TaskManager.Task::(_updateState) Task=`4e3eef40-5956-4506-8125-4b6c1b01a005`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:02:35,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:02:35,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:02:35,761::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:02:35,768::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:02:35,769::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:02:35,769::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:02:35,776::task::990::TaskManager.Task::(_decref) Task=`4e3eef40-5956-4506-8125-4b6c1b01a005`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:02:36,847::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:02:36,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000671402 s, 742 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:37,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.07606 s, 202 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:02:37,593::task::595::TaskManager.Task::(_updateState) Task=`5bc7391d-874d-4c11-b34e-c75fdb3299b4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:02:37,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:02:37,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671402', 'lastCheck': '0.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:02:37,595::task::1185::TaskManager.Task::(prepare) Task=`5bc7391d-874d-4c11-b34e-c75fdb3299b4`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671402', 'lastCheck': '0.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:02:37,595::task::595::TaskManager.Task::(_updateState) Task=`5bc7391d-874d-4c11-b34e-c75fdb3299b4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:02:37,599::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:02:37,601::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:02:37,607::task::990::TaskManager.Task::(_decref) Task=`5bc7391d-874d-4c11-b34e-c75fdb3299b4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:02:39,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:39,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0582703 s, 17.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:41,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:41,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128693 s, 8.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:43,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:43,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150506 s, 6.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:45,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:45,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902155 s, 11.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:02:46,333::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-13::DEBUG::2014-08-21 11:02:46,335::task::595::TaskManager.Task::(_updateState) Task=`372bf34c-bbd1-4fed-bc0e-1dc164e8954f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:02:46,335::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:02:46,336::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:02:46,336::task::1185::TaskManager.Task::(prepare) Task=`372bf34c-bbd1-4fed-bc0e-1dc164e8954f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:02:46,336::task::595::TaskManager.Task::(_updateState) Task=`372bf34c-bbd1-4fed-bc0e-1dc164e8954f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:02:46,336::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:02:46,337::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:02:46,337::task::990::TaskManager.Task::(_decref) Task=`372bf34c-bbd1-4fed-bc0e-1dc164e8954f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:02:46,345::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-34::DEBUG::2014-08-21 11:02:46,346::task::595::TaskManager.Task::(_updateState) Task=`773879b2-b2f7-4650-ab26-3f974dbf1ca9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:02:46,348::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:02:46,350::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0a4dcf72-e6f7-4258-aa52-f9da4e583bd9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:02:46,350::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:02:46,350::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:02:46,351::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0a4dcf72-e6f7-4258-aa52-f9da4e583bd9`::Granted request
>Thread-34::DEBUG::2014-08-21 11:02:46,351::task::827::TaskManager.Task::(resourceAcquired) Task=`773879b2-b2f7-4650-ab26-3f974dbf1ca9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:02:46,352::task::990::TaskManager.Task::(_decref) Task=`773879b2-b2f7-4650-ab26-3f974dbf1ca9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:02:46,357::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:46,358::task::1185::TaskManager.Task::(prepare) Task=`773879b2-b2f7-4650-ab26-3f974dbf1ca9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:46,359::task::595::TaskManager.Task::(_updateState) Task=`773879b2-b2f7-4650-ab26-3f974dbf1ca9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:02:46,359::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:02:46,359::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:02:46,360::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:02:46,360::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:02:46,360::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:02:46,361::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:02:46,361::task::990::TaskManager.Task::(_decref) Task=`773879b2-b2f7-4650-ab26-3f974dbf1ca9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:02:46,975::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:02:47,005::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000694997 s, 717 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:47,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:48,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0845383 s, 12.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:51,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:02:56,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.60123 s, 284 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:02:56,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-13::DEBUG::2014-08-21 11:02:56,438::task::595::TaskManager.Task::(_updateState) Task=`207cd02c-8e60-4301-9856-7b1cba26162b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:02:56,440::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:02:56,441::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:02:56,441::task::1185::TaskManager.Task::(prepare) Task=`207cd02c-8e60-4301-9856-7b1cba26162b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:02:56,441::task::595::TaskManager.Task::(_updateState) Task=`207cd02c-8e60-4301-9856-7b1cba26162b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:02:56,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:02:56,442::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:02:56,442::task::990::TaskManager.Task::(_decref) Task=`207cd02c-8e60-4301-9856-7b1cba26162b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:02:56,448::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-34::DEBUG::2014-08-21 11:02:56,448::task::595::TaskManager.Task::(_updateState) Task=`f2e7f30a-35f4-4d94-ad84-522a05ed6eaa`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:02:56,449::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:02:56,450::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`823f7035-09ec-4385-a524-072ebeefc62e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:02:56,450::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:02:56,451::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:02:56,451::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`823f7035-09ec-4385-a524-072ebeefc62e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:02:56,452::task::827::TaskManager.Task::(resourceAcquired) Task=`f2e7f30a-35f4-4d94-ad84-522a05ed6eaa`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:02:56,452::task::990::TaskManager.Task::(_decref) Task=`f2e7f30a-35f4-4d94-ad84-522a05ed6eaa`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:02:56,458::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:56,459::task::1185::TaskManager.Task::(prepare) Task=`f2e7f30a-35f4-4d94-ad84-522a05ed6eaa`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897243648', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:02:56,459::task::595::TaskManager.Task::(_updateState) Task=`f2e7f30a-35f4-4d94-ad84-522a05ed6eaa`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:02:56,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:02:56,460::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:02:56,460::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:02:56,460::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:02:56,461::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:02:56,461::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:02:56,461::task::990::TaskManager.Task::(_decref) Task=`f2e7f30a-35f4-4d94-ad84-522a05ed6eaa`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:02:57,070::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:02:57,085::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000614494 s, 810 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:02:58,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:02:58,978::task::595::TaskManager.Task::(_updateState) Task=`c0e310ce-0c9a-4a93-b923-9f7f14931df7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:02:58,980::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:02:58,981::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614494', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:02:58,981::task::1185::TaskManager.Task::(prepare) Task=`c0e310ce-0c9a-4a93-b923-9f7f14931df7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614494', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:02:58,993::task::595::TaskManager.Task::(_updateState) Task=`c0e310ce-0c9a-4a93-b923-9f7f14931df7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:02:59,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:02:59,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:02:59,068::task::990::TaskManager.Task::(_decref) Task=`c0e310ce-0c9a-4a93-b923-9f7f14931df7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:02:59,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.782975 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:01,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:01,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.177939 s, 5.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:03,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:04,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.842511 s, 1.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:03:06,482::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-13::DEBUG::2014-08-21 11:03:06,483::task::595::TaskManager.Task::(_updateState) Task=`6890892c-c4b1-416d-b176-d3d45c44b6b9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:03:06,484::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:03:06,485::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:06,485::task::1185::TaskManager.Task::(prepare) Task=`6890892c-c4b1-416d-b176-d3d45c44b6b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:06,486::task::595::TaskManager.Task::(_updateState) Task=`6890892c-c4b1-416d-b176-d3d45c44b6b9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:03:06,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:03:06,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:03:06,487::task::990::TaskManager.Task::(_decref) Task=`6890892c-c4b1-416d-b176-d3d45c44b6b9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:03:06,560::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 11:03:06,562::task::595::TaskManager.Task::(_updateState) Task=`8e47b493-4e73-4987-b90a-73f9645fe4c3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:03:06,563::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:03:06,564::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5c25cff7-7d69-4a97-9ae3-96d5514bce66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:03:06,564::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:03:06,565::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:03:06,565::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5c25cff7-7d69-4a97-9ae3-96d5514bce66`::Granted request
>Thread-34::DEBUG::2014-08-21 11:03:06,566::task::827::TaskManager.Task::(resourceAcquired) Task=`8e47b493-4e73-4987-b90a-73f9645fe4c3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:03:06,566::task::990::TaskManager.Task::(_decref) Task=`8e47b493-4e73-4987-b90a-73f9645fe4c3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:03:06,572::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:06,572::task::1185::TaskManager.Task::(prepare) Task=`8e47b493-4e73-4987-b90a-73f9645fe4c3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:06,573::task::595::TaskManager.Task::(_updateState) Task=`8e47b493-4e73-4987-b90a-73f9645fe4c3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:03:06,573::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:03:06,573::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:03:06,574::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:03:06,574::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:03:06,574::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:03:06,575::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:03:06,575::task::990::TaskManager.Task::(_decref) Task=`8e47b493-4e73-4987-b90a-73f9645fe4c3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:03:06,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:03:07,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:03:07,557::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0023231 s, 214 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:07,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.786474 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:09,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:11,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.16913 s, 876 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:13,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:13,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0944365 s, 10.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:03:14,211::task::595::TaskManager.Task::(_updateState) Task=`bb75bd4d-e567-4836-88ec-0859220a0adc`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:03:14,212::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:03:14,212::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023231', 'lastCheck': '6.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:03:14,212::task::1185::TaskManager.Task::(prepare) Task=`bb75bd4d-e567-4836-88ec-0859220a0adc`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023231', 'lastCheck': '6.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:03:14,213::task::595::TaskManager.Task::(_updateState) Task=`bb75bd4d-e567-4836-88ec-0859220a0adc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:03:14,213::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:03:14,213::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:03:14,214::task::990::TaskManager.Task::(_decref) Task=`bb75bd4d-e567-4836-88ec-0859220a0adc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:03:15,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:15,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.152797 s, 6.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:03:16,593::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-13::DEBUG::2014-08-21 11:03:16,595::task::595::TaskManager.Task::(_updateState) Task=`fe8636a9-a67c-4574-8565-1abe54587789`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:03:16,596::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:03:16,597::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:16,597::task::1185::TaskManager.Task::(prepare) Task=`fe8636a9-a67c-4574-8565-1abe54587789`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:16,597::task::595::TaskManager.Task::(_updateState) Task=`fe8636a9-a67c-4574-8565-1abe54587789`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:03:16,598::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:03:16,598::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:03:16,599::task::990::TaskManager.Task::(_decref) Task=`fe8636a9-a67c-4574-8565-1abe54587789`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:03:16,607::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-34::DEBUG::2014-08-21 11:03:16,608::task::595::TaskManager.Task::(_updateState) Task=`761990c8-b5fd-4d41-a396-686f41ccd610`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:03:16,608::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:03:16,609::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d708f1a3-05fb-4bbe-a310-7795dc985545`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:03:16,609::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:03:16,610::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:03:16,610::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d708f1a3-05fb-4bbe-a310-7795dc985545`::Granted request
>Thread-34::DEBUG::2014-08-21 11:03:16,613::task::827::TaskManager.Task::(resourceAcquired) Task=`761990c8-b5fd-4d41-a396-686f41ccd610`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:03:16,613::task::990::TaskManager.Task::(_decref) Task=`761990c8-b5fd-4d41-a396-686f41ccd610`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:03:16,620::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897178112', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:16,620::task::1185::TaskManager.Task::(prepare) Task=`761990c8-b5fd-4d41-a396-686f41ccd610`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897178112', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:16,621::task::595::TaskManager.Task::(_updateState) Task=`761990c8-b5fd-4d41-a396-686f41ccd610`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:03:16,621::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:03:16,621::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:03:16,622::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:03:16,622::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:03:16,623::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:03:16,623::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:03:16,624::task::990::TaskManager.Task::(_decref) Task=`761990c8-b5fd-4d41-a396-686f41ccd610`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:03:17,639::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:17,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:03:17,939::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.019314 s, 25.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:18,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.254561 s, 4.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:20,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:20,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0758623 s, 13.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:22,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:22,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.131507 s, 7.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:24,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:24,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0878056 s, 11.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:03:26,645::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-13::DEBUG::2014-08-21 11:03:26,646::task::595::TaskManager.Task::(_updateState) Task=`6ac7429e-06c6-477f-92c3-c015d972887b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:03:26,647::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:03:26,648::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:26,648::task::1185::TaskManager.Task::(prepare) Task=`6ac7429e-06c6-477f-92c3-c015d972887b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:26,648::task::595::TaskManager.Task::(_updateState) Task=`6ac7429e-06c6-477f-92c3-c015d972887b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:03:26,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:03:26,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:03:26,649::task::990::TaskManager.Task::(_decref) Task=`6ac7429e-06c6-477f-92c3-c015d972887b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:03:26,655::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-34::DEBUG::2014-08-21 11:03:26,656::task::595::TaskManager.Task::(_updateState) Task=`9e3f93f7-3578-41d0-a7ac-e079ec027928`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:03:26,657::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:03:26,658::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`faf311dd-9155-465d-899e-4c4aa8012c7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:03:26,658::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:03:26,658::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:03:26,659::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`faf311dd-9155-465d-899e-4c4aa8012c7b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:03:26,659::task::827::TaskManager.Task::(resourceAcquired) Task=`9e3f93f7-3578-41d0-a7ac-e079ec027928`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:03:26,659::task::990::TaskManager.Task::(_decref) Task=`9e3f93f7-3578-41d0-a7ac-e079ec027928`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:03:26,665::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897178112', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:26,666::task::1185::TaskManager.Task::(prepare) Task=`9e3f93f7-3578-41d0-a7ac-e079ec027928`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535897178112', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:26,666::task::595::TaskManager.Task::(_updateState) Task=`9e3f93f7-3578-41d0-a7ac-e079ec027928`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:03:26,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:03:26,667::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:03:26,667::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:03:26,668::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:03:26,668::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:03:26,668::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:03:26,668::task::990::TaskManager.Task::(_decref) Task=`9e3f93f7-3578-41d0-a7ac-e079ec027928`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:03:26,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:03:28,249::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:03:28,387::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0089213 s, 55.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:28,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.23995 s, 826 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:03:29,454::task::595::TaskManager.Task::(_updateState) Task=`9e2c0a71-bda4-4c96-9bde-9747c46f000b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:03:29,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:03:29,456::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0089213', 'lastCheck': '0.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:03:29,456::task::1185::TaskManager.Task::(prepare) Task=`9e2c0a71-bda4-4c96-9bde-9747c46f000b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0089213', 'lastCheck': '0.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:03:29,456::task::595::TaskManager.Task::(_updateState) Task=`9e2c0a71-bda4-4c96-9bde-9747c46f000b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:03:29,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:03:29,457::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:03:29,457::task::990::TaskManager.Task::(_decref) Task=`9e2c0a71-bda4-4c96-9bde-9747c46f000b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:03:30,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:31,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0624241 s, 16.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:33,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:33,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0602497 s, 17.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:35,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:35,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110064 s, 9.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:03:36,692::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-13::DEBUG::2014-08-21 11:03:36,693::task::595::TaskManager.Task::(_updateState) Task=`582e7514-1082-46af-82d7-ab607c116a6a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:03:36,693::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:03:36,694::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:36,694::task::1185::TaskManager.Task::(prepare) Task=`582e7514-1082-46af-82d7-ab607c116a6a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:36,694::task::595::TaskManager.Task::(_updateState) Task=`582e7514-1082-46af-82d7-ab607c116a6a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:03:36,694::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:03:36,695::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:03:36,695::task::990::TaskManager.Task::(_decref) Task=`582e7514-1082-46af-82d7-ab607c116a6a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:03:36,699::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 11:03:36,700::task::595::TaskManager.Task::(_updateState) Task=`6520b2e3-5933-4120-94c8-9337e0bdd033`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:03:36,700::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:03:36,700::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b29f328f-a34a-4ccc-b129-26aafa5b1cef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:03:36,701::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:03:36,701::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:03:36,701::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b29f328f-a34a-4ccc-b129-26aafa5b1cef`::Granted request
>Thread-34::DEBUG::2014-08-21 11:03:36,702::task::827::TaskManager.Task::(resourceAcquired) Task=`6520b2e3-5933-4120-94c8-9337e0bdd033`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:03:36,702::task::990::TaskManager.Task::(_decref) Task=`6520b2e3-5933-4120-94c8-9337e0bdd033`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:03:36,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:36,706::task::1185::TaskManager.Task::(prepare) Task=`6520b2e3-5933-4120-94c8-9337e0bdd033`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:36,707::task::595::TaskManager.Task::(_updateState) Task=`6520b2e3-5933-4120-94c8-9337e0bdd033`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:03:36,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:03:36,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:03:36,707::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:03:36,708::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:03:36,708::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:03:36,708::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:03:36,708::task::990::TaskManager.Task::(_decref) Task=`6520b2e3-5933-4120-94c8-9337e0bdd033`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:03:37,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:37,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0977006 s, 10.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:03:38,671::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:03:38,690::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00104271 s, 478 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:39,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:39,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0640186 s, 16.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:41,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:41,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0675755 s, 15.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:44,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:44,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.216068 s, 4.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:03:44,612::task::595::TaskManager.Task::(_updateState) Task=`fc060cc6-91f6-4f71-bc9e-0c3e26972b2e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:03:44,613::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:03:44,613::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104271', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:03:44,614::task::1185::TaskManager.Task::(prepare) Task=`fc060cc6-91f6-4f71-bc9e-0c3e26972b2e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104271', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:03:44,614::task::595::TaskManager.Task::(_updateState) Task=`fc060cc6-91f6-4f71-bc9e-0c3e26972b2e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:03:44,614::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:03:44,614::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:03:44,614::task::990::TaskManager.Task::(_decref) Task=`fc060cc6-91f6-4f71-bc9e-0c3e26972b2e`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:03:46,732::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-13::DEBUG::2014-08-21 11:03:46,733::task::595::TaskManager.Task::(_updateState) Task=`0319b98b-b40f-4b1f-96ef-6014b2eba5a1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:03:46,734::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:03:46,735::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:46,735::task::1185::TaskManager.Task::(prepare) Task=`0319b98b-b40f-4b1f-96ef-6014b2eba5a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:03:46,735::task::595::TaskManager.Task::(_updateState) Task=`0319b98b-b40f-4b1f-96ef-6014b2eba5a1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:03:46,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:03:46,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:03:46,736::task::990::TaskManager.Task::(_decref) Task=`0319b98b-b40f-4b1f-96ef-6014b2eba5a1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:03:46,743::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 11:03:46,744::task::595::TaskManager.Task::(_updateState) Task=`419249d9-59d1-4f3f-91b2-7b3d4ae6dfb1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:03:46,744::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:03:46,745::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3c715046-875f-4afd-bff3-c612e8313b77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:03:46,746::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:03:46,746::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:03:46,747::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3c715046-875f-4afd-bff3-c612e8313b77`::Granted request
>Thread-34::DEBUG::2014-08-21 11:03:46,747::task::827::TaskManager.Task::(resourceAcquired) Task=`419249d9-59d1-4f3f-91b2-7b3d4ae6dfb1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:03:46,748::task::990::TaskManager.Task::(_decref) Task=`419249d9-59d1-4f3f-91b2-7b3d4ae6dfb1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:03:46,754::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:46,754::task::1185::TaskManager.Task::(prepare) Task=`419249d9-59d1-4f3f-91b2-7b3d4ae6dfb1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896915968', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:03:46,755::task::595::TaskManager.Task::(_updateState) Task=`419249d9-59d1-4f3f-91b2-7b3d4ae6dfb1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:03:46,755::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:03:46,756::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:03:46,756::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:03:46,756::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:03:46,757::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:03:46,757::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:03:46,757::task::990::TaskManager.Task::(_decref) Task=`419249d9-59d1-4f3f-91b2-7b3d4ae6dfb1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:03:46,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:47,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0959778 s, 10.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:03:48,699::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:03:48,709::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:03:48,713::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:03:48,725::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 11:03:48,728::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:03:48,728::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:03:48,728::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 11:03:48,790::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:03:48,830::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00076583 s, 650 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:49,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:49,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.127975 s, 8.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:51,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:51,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137722 s, 7.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:53,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:03:54,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0652351 s, 15.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:03:56,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:04:03,160::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:04:03,272::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-13::DEBUG::2014-08-21 11:04:03,491::task::595::TaskManager.Task::(_updateState) Task=`c09a0f92-d848-4d13-ad75-45c37c2a3098`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:04:03,492::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:04:03,497::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:04:03,497::task::1185::TaskManager.Task::(prepare) Task=`c09a0f92-d848-4d13-ad75-45c37c2a3098`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:04:03,497::task::595::TaskManager.Task::(_updateState) Task=`c09a0f92-d848-4d13-ad75-45c37c2a3098`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:04:03,502::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:04:03,502::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:04:03,502::task::990::TaskManager.Task::(_decref) Task=`c09a0f92-d848-4d13-ad75-45c37c2a3098`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:04:04,121::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00705213 s, 70.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:04,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100139 s, 10.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:04:08,215::task::595::TaskManager.Task::(_updateState) Task=`987267e7-2799-4033-be79-f65775257416`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:04:08,215::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:04:08,216::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00705213', 'lastCheck': '3.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:04:08,216::task::1185::TaskManager.Task::(prepare) Task=`987267e7-2799-4033-be79-f65775257416`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00705213', 'lastCheck': '3.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:04:08,216::task::595::TaskManager.Task::(_updateState) Task=`987267e7-2799-4033-be79-f65775257416`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:04:08,216::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:04:08,217::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:04:08,217::task::990::TaskManager.Task::(_decref) Task=`987267e7-2799-4033-be79-f65775257416`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:04:08,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:04:08,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-34::DEBUG::2014-08-21 11:04:08,286::task::595::TaskManager.Task::(_updateState) Task=`a53cfc05-ae77-4794-915e-b569930730d8`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:04:08,288::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:04:08,289::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bc7f6da2-9c2a-43f7-98bb-a1774bdd6429`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:04:08,289::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:04:08,290::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:04:08,291::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bc7f6da2-9c2a-43f7-98bb-a1774bdd6429`::Granted request
>Thread-34::DEBUG::2014-08-21 11:04:08,292::task::827::TaskManager.Task::(resourceAcquired) Task=`a53cfc05-ae77-4794-915e-b569930730d8`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:04:08,293::task::990::TaskManager.Task::(_decref) Task=`a53cfc05-ae77-4794-915e-b569930730d8`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:04:08,300::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:08,300::task::1185::TaskManager.Task::(prepare) Task=`a53cfc05-ae77-4794-915e-b569930730d8`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:08,301::task::595::TaskManager.Task::(_updateState) Task=`a53cfc05-ae77-4794-915e-b569930730d8`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:04:08,301::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:04:08,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:04:08,303::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:04:08,304::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:04:08,305::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:04:08,305::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:04:08,306::task::990::TaskManager.Task::(_decref) Task=`a53cfc05-ae77-4794-915e-b569930730d8`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:04:08,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0867509 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:10,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:04:10,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0510123 s, 20.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:12,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:04:17,424::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:04:17,462::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000601414 s, 828 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:17,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.91616 s, 534 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:04:18,330::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-13::DEBUG::2014-08-21 11:04:18,332::task::595::TaskManager.Task::(_updateState) Task=`02e27ccb-f805-45f5-addb-fe0e309a4d3c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:04:18,332::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:04:18,333::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:04:18,333::task::1185::TaskManager.Task::(prepare) Task=`02e27ccb-f805-45f5-addb-fe0e309a4d3c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:04:18,334::task::595::TaskManager.Task::(_updateState) Task=`02e27ccb-f805-45f5-addb-fe0e309a4d3c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:04:18,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:04:18,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:04:18,335::task::990::TaskManager.Task::(_decref) Task=`02e27ccb-f805-45f5-addb-fe0e309a4d3c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:04:18,341::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-34::DEBUG::2014-08-21 11:04:18,342::task::595::TaskManager.Task::(_updateState) Task=`54c9acbf-13a3-4a61-a3c7-dfe8a404807e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:04:18,342::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:04:18,343::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`48901eec-2d63-406d-b2b4-5dcb4b208d1d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:04:18,343::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:04:18,344::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:04:18,344::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`48901eec-2d63-406d-b2b4-5dcb4b208d1d`::Granted request
>Thread-34::DEBUG::2014-08-21 11:04:18,345::task::827::TaskManager.Task::(resourceAcquired) Task=`54c9acbf-13a3-4a61-a3c7-dfe8a404807e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:04:18,345::task::990::TaskManager.Task::(_decref) Task=`54c9acbf-13a3-4a61-a3c7-dfe8a404807e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:04:18,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:18,352::task::1185::TaskManager.Task::(prepare) Task=`54c9acbf-13a3-4a61-a3c7-dfe8a404807e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:18,352::task::595::TaskManager.Task::(_updateState) Task=`54c9acbf-13a3-4a61-a3c7-dfe8a404807e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:04:18,352::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:04:18,353::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:04:18,353::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:04:18,354::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:04:18,354::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:04:18,354::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:04:18,355::task::990::TaskManager.Task::(_decref) Task=`54c9acbf-13a3-4a61-a3c7-dfe8a404807e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:04:20,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:04:24,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.52281 s, 291 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:26,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:04:29,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-26::DEBUG::2014-08-21 11:04:29,424::task::595::TaskManager.Task::(_updateState) Task=`e678f8e1-076a-4814-b241-12fa78739f3e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:04:29,461::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:04:29,564::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:04:29,565::task::1185::TaskManager.Task::(prepare) Task=`e678f8e1-076a-4814-b241-12fa78739f3e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:04:29,565::task::595::TaskManager.Task::(_updateState) Task=`e678f8e1-076a-4814-b241-12fa78739f3e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:04:29,565::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:04:29,566::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:04:29,566::task::990::TaskManager.Task::(_decref) Task=`e678f8e1-076a-4814-b241-12fa78739f3e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:04:30,660::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-13::DEBUG::2014-08-21 11:04:30,686::task::595::TaskManager.Task::(_updateState) Task=`27fed1e0-ff22-4445-947d-f64f42086813`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:04:30,687::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:04:30,688::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601414', 'lastCheck': '13.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:04:30,696::task::1185::TaskManager.Task::(prepare) Task=`27fed1e0-ff22-4445-947d-f64f42086813`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601414', 'lastCheck': '13.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:04:30,697::task::595::TaskManager.Task::(_updateState) Task=`27fed1e0-ff22-4445-947d-f64f42086813`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:04:30,699::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-15::DEBUG::2014-08-21 11:04:30,730::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:04:30,705::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:04:31,786::task::990::TaskManager.Task::(_decref) Task=`27fed1e0-ff22-4445-947d-f64f42086813`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:04:31,191::task::595::TaskManager.Task::(_updateState) Task=`e705a2ad-8957-4298-af5e-d9a9f1c1372d`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 11:04:31,784::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0162673 s, 30.6 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:04:32,239::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:04:32,241::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`39a0b870-948c-4b1b-882d-1383e144c529`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:04:32,241::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:04:32,242::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:04:32,243::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`39a0b870-948c-4b1b-882d-1383e144c529`::Granted request
>Thread-34::DEBUG::2014-08-21 11:04:32,382::task::827::TaskManager.Task::(resourceAcquired) Task=`e705a2ad-8957-4298-af5e-d9a9f1c1372d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:04:32,394::task::990::TaskManager.Task::(_decref) Task=`e705a2ad-8957-4298-af5e-d9a9f1c1372d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:04:32,563::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:32,565::task::1185::TaskManager.Task::(prepare) Task=`e705a2ad-8957-4298-af5e-d9a9f1c1372d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895998464', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:32,565::task::595::TaskManager.Task::(_updateState) Task=`e705a2ad-8957-4298-af5e-d9a9f1c1372d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:04:32,566::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:04:32,567::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:04:32,568::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:04:32,569::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:04:32,569::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:04:32,570::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:04:32,571::task::990::TaskManager.Task::(_decref) Task=`e705a2ad-8957-4298-af5e-d9a9f1c1372d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:04:32,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.21289 s, 165 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:34,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:04:35,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0703039 s, 14.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:37,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:04:37,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0836806 s, 12.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:39,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:04:39,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0871067 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:42,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:04:42,742::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-13::DEBUG::2014-08-21 11:04:42,743::task::595::TaskManager.Task::(_updateState) Task=`5905fff2-4d03-42a3-8f98-621a5df07349`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:04:42,744::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:04:42,745::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:04:42,745::task::1185::TaskManager.Task::(prepare) Task=`5905fff2-4d03-42a3-8f98-621a5df07349`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:04:42,746::task::595::TaskManager.Task::(_updateState) Task=`5905fff2-4d03-42a3-8f98-621a5df07349`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:04:42,746::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:04:42,747::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:04:42,748::task::990::TaskManager.Task::(_decref) Task=`5905fff2-4d03-42a3-8f98-621a5df07349`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:04:43,051::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-34::DEBUG::2014-08-21 11:04:43,084::task::595::TaskManager.Task::(_updateState) Task=`12e2fc2f-3374-452e-b511-b800636a1f03`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:04:43,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:04:43,132::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`689a4439-255e-4e8d-b055-2129814388d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:04:43,135::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:04:43,141::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:04:43,146::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`689a4439-255e-4e8d-b055-2129814388d2`::Granted request
>Thread-34::DEBUG::2014-08-21 11:04:43,155::task::827::TaskManager.Task::(resourceAcquired) Task=`12e2fc2f-3374-452e-b511-b800636a1f03`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:04:43,159::task::990::TaskManager.Task::(_decref) Task=`12e2fc2f-3374-452e-b511-b800636a1f03`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:04:43,277::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:43,283::task::1185::TaskManager.Task::(prepare) Task=`12e2fc2f-3374-452e-b511-b800636a1f03`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:43,289::task::595::TaskManager.Task::(_updateState) Task=`12e2fc2f-3374-452e-b511-b800636a1f03`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:04:43,294::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:04:43,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:04:43,311::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:04:43,318::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:04:43,325::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:04:43,330::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:04:43,341::task::990::TaskManager.Task::(_decref) Task=`12e2fc2f-3374-452e-b511-b800636a1f03`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:04:43,371::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:04:43,422::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000969725 s, 514 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:43,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.91389 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:45,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:04:45,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0651188 s, 15.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:47,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:04:49,872::task::595::TaskManager.Task::(_updateState) Task=`9e52bd0e-002b-4306-8c6d-8056dfa33413`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:04:49,874::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:04:49,875::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000969725', 'lastCheck': '6.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:04:49,876::task::1185::TaskManager.Task::(prepare) Task=`9e52bd0e-002b-4306-8c6d-8056dfa33413`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000969725', 'lastCheck': '6.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:04:49,876::task::595::TaskManager.Task::(_updateState) Task=`9e52bd0e-002b-4306-8c6d-8056dfa33413`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:04:49,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:04:49,907::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:04:49,916::task::990::TaskManager.Task::(_decref) Task=`9e52bd0e-002b-4306-8c6d-8056dfa33413`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:04:50,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.689008 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:52,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:04:52,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.163544 s, 6.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:04:53,386::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-13::DEBUG::2014-08-21 11:04:53,388::task::595::TaskManager.Task::(_updateState) Task=`3ed7814d-470d-43f9-9ed7-f64feef69fdb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:04:53,388::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:04:53,389::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:04:53,390::task::1185::TaskManager.Task::(prepare) Task=`3ed7814d-470d-43f9-9ed7-f64feef69fdb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:04:53,390::task::595::TaskManager.Task::(_updateState) Task=`3ed7814d-470d-43f9-9ed7-f64feef69fdb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:04:53,390::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:04:53,391::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:04:53,391::task::990::TaskManager.Task::(_decref) Task=`3ed7814d-470d-43f9-9ed7-f64feef69fdb`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:04:53,397::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-34::DEBUG::2014-08-21 11:04:53,398::task::595::TaskManager.Task::(_updateState) Task=`f843b21e-a4dd-4749-bad7-26ea96fa3be3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:04:53,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:04:53,400::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`97e3cc26-d67d-435d-8fb1-fa1edd801e57`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:04:53,400::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:04:53,401::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:04:53,402::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`97e3cc26-d67d-435d-8fb1-fa1edd801e57`::Granted request
>Thread-34::DEBUG::2014-08-21 11:04:53,402::task::827::TaskManager.Task::(resourceAcquired) Task=`f843b21e-a4dd-4749-bad7-26ea96fa3be3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:04:53,403::task::990::TaskManager.Task::(_decref) Task=`f843b21e-a4dd-4749-bad7-26ea96fa3be3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:04:53,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:53,411::task::1185::TaskManager.Task::(prepare) Task=`f843b21e-a4dd-4749-bad7-26ea96fa3be3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:04:53,411::task::595::TaskManager.Task::(_updateState) Task=`f843b21e-a4dd-4749-bad7-26ea96fa3be3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:04:53,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:04:53,411::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:04:53,412::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:04:53,412::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:04:53,412::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:04:53,413::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:04:53,413::task::990::TaskManager.Task::(_decref) Task=`f843b21e-a4dd-4749-bad7-26ea96fa3be3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:04:53,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:04:53,785::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0118868 s, 41.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:54,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:04:57,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.26933 s, 807 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:04:59,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:05:00,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111215 s, 9.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:05:05,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Dummy-33::DEBUG::2014-08-21 11:05:05,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:05:05,639::task::595::TaskManager.Task::(_updateState) Task=`81bad67e-4fa9-42a8-9637-113665fc75c4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:05:05,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:05:05,674::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:05:05,678::task::1185::TaskManager.Task::(prepare) Task=`81bad67e-4fa9-42a8-9637-113665fc75c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:05:05,684::task::595::TaskManager.Task::(_updateState) Task=`81bad67e-4fa9-42a8-9637-113665fc75c4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:05:05,691::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:05:05,695::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:05:05,700::task::990::TaskManager.Task::(_decref) Task=`81bad67e-4fa9-42a8-9637-113665fc75c4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:05:05,725::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Thread-34::DEBUG::2014-08-21 11:05:05,732::task::595::TaskManager.Task::(_updateState) Task=`43ca271a-87b4-4333-ad41-3a21dfa2835b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:05:05,736::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:05:05,746::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac31dc51-62ec-46ed-91a4-1f8f866412ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:05:05,750::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:05:05,755::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:05:05,760::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac31dc51-62ec-46ed-91a4-1f8f866412ba`::Granted request
>Thread-15::DEBUG::2014-08-21 11:05:05,766::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:05:05,767::task::827::TaskManager.Task::(resourceAcquired) Task=`43ca271a-87b4-4333-ad41-3a21dfa2835b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:05:05,784::task::990::TaskManager.Task::(_decref) Task=`43ca271a-87b4-4333-ad41-3a21dfa2835b`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:05:05,836::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00141984 s, 351 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:05:05,861::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:05,866::task::1185::TaskManager.Task::(prepare) Task=`43ca271a-87b4-4333-ad41-3a21dfa2835b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:05,871::task::595::TaskManager.Task::(_updateState) Task=`43ca271a-87b4-4333-ad41-3a21dfa2835b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:05:05,875::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:05:05,879::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:05:05,939::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:05:05,945::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:05:05,947::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:05:05,949::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:05:05,953::task::990::TaskManager.Task::(_decref) Task=`43ca271a-87b4-4333-ad41-3a21dfa2835b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:05:06,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.465294 s, 2.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:08,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:05:08,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900223 s, 11.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:10,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:05:11,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0804534 s, 12.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:05:11,559::task::595::TaskManager.Task::(_updateState) Task=`78122e6f-e845-4152-a074-ee0f5babd0c1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:05:11,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:05:11,560::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00141984', 'lastCheck': '5.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:05:11,560::task::1185::TaskManager.Task::(prepare) Task=`78122e6f-e845-4152-a074-ee0f5babd0c1`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00141984', 'lastCheck': '5.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:05:11,560::task::595::TaskManager.Task::(_updateState) Task=`78122e6f-e845-4152-a074-ee0f5babd0c1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:05:11,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:05:11,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:05:11,561::task::990::TaskManager.Task::(_decref) Task=`78122e6f-e845-4152-a074-ee0f5babd0c1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:05:13,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:05:13,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0543061 s, 18.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:15,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:05:16,025::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-26::DEBUG::2014-08-21 11:05:16,029::task::595::TaskManager.Task::(_updateState) Task=`764688f1-2af5-4a60-a64d-62c5cebd5998`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:05:16,032::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:05:16,037::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:05:16,041::task::1185::TaskManager.Task::(prepare) Task=`764688f1-2af5-4a60-a64d-62c5cebd5998`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:05:16,044::task::595::TaskManager.Task::(_updateState) Task=`764688f1-2af5-4a60-a64d-62c5cebd5998`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:05:16,047::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:05:16,050::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:05:16,055::task::990::TaskManager.Task::(_decref) Task=`764688f1-2af5-4a60-a64d-62c5cebd5998`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:05:16,096::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 11:05:16,107::task::595::TaskManager.Task::(_updateState) Task=`4848262a-43e6-449d-968b-f6c9fe57cd9c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:05:16,114::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:05:16,129::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b73e2cd9-fb94-40af-b863-1ed4bd082084`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:05:16,137::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:05:16,160::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-15::DEBUG::2014-08-21 11:05:16,160::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:05:16,175::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b73e2cd9-fb94-40af-b863-1ed4bd082084`::Granted request
>Thread-34::DEBUG::2014-08-21 11:05:16,193::task::827::TaskManager.Task::(resourceAcquired) Task=`4848262a-43e6-449d-968b-f6c9fe57cd9c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:05:16,196::task::990::TaskManager.Task::(_decref) Task=`4848262a-43e6-449d-968b-f6c9fe57cd9c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:05:16,248::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:16,250::task::1185::TaskManager.Task::(prepare) Task=`4848262a-43e6-449d-968b-f6c9fe57cd9c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:16,252::task::595::TaskManager.Task::(_updateState) Task=`4848262a-43e6-449d-968b-f6c9fe57cd9c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:05:16,254::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:05:16,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:05:16,262::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:05:16,266::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:05:16,269::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:05:16,271::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:05:16,274::task::990::TaskManager.Task::(_decref) Task=`4848262a-43e6-449d-968b-f6c9fe57cd9c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:05:16,289::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00207952 s, 239 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:16,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.21466 s, 843 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:18,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:05:18,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.141306 s, 7.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:20,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:05:28,232::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-13::DEBUG::2014-08-21 11:05:28,495::task::595::TaskManager.Task::(_updateState) Task=`c334eb19-d9bc-4d60-80b7-70f278912257`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:05:28,525::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:05:28,552::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:05:28,559::task::1185::TaskManager.Task::(prepare) Task=`c334eb19-d9bc-4d60-80b7-70f278912257`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:05:28,571::task::595::TaskManager.Task::(_updateState) Task=`c334eb19-d9bc-4d60-80b7-70f278912257`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:05:28,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:05:28,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:05:28,600::task::990::TaskManager.Task::(_decref) Task=`c334eb19-d9bc-4d60-80b7-70f278912257`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:05:28,702::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-34::DEBUG::2014-08-21 11:05:28,703::task::595::TaskManager.Task::(_updateState) Task=`2929a12d-9555-47b3-86e4-069b4e1f4faa`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:05:28,704::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:05:28,705::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6020e39a-8e82-45bd-8a3b-ca608afdaf43`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:05:28,705::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:05:28,706::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:05:28,707::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6020e39a-8e82-45bd-8a3b-ca608afdaf43`::Granted request
>Thread-34::DEBUG::2014-08-21 11:05:28,708::task::827::TaskManager.Task::(resourceAcquired) Task=`2929a12d-9555-47b3-86e4-069b4e1f4faa`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:05:28,708::task::990::TaskManager.Task::(_decref) Task=`2929a12d-9555-47b3-86e4-069b4e1f4faa`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:05:29,002::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:05:29,100::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:29,101::task::1185::TaskManager.Task::(prepare) Task=`2929a12d-9555-47b3-86e4-069b4e1f4faa`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:29,111::task::595::TaskManager.Task::(_updateState) Task=`2929a12d-9555-47b3-86e4-069b4e1f4faa`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:05:29,111::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:05:29,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:05:29,113::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:05:29,113::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:05:29,114::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:05:29,114::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:05:29,115::task::990::TaskManager.Task::(_decref) Task=`2929a12d-9555-47b3-86e4-069b4e1f4faa`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:05:29,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00332219 s, 150 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:29,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.70103 s, 118 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:31,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:05:35,846::task::595::TaskManager.Task::(_updateState) Task=`d0b4365f-5fe7-439e-b70e-21cb12801114`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:05:35,847::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:05:35,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00332219', 'lastCheck': '6.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:05:35,853::task::1185::TaskManager.Task::(prepare) Task=`d0b4365f-5fe7-439e-b70e-21cb12801114`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00332219', 'lastCheck': '6.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:05:35,855::task::595::TaskManager.Task::(_updateState) Task=`d0b4365f-5fe7-439e-b70e-21cb12801114`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:05:35,856::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:05:35,857::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:05:35,858::task::990::TaskManager.Task::(_decref) Task=`d0b4365f-5fe7-439e-b70e-21cb12801114`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:05:40,673::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-26::DEBUG::2014-08-21 11:05:40,674::task::595::TaskManager.Task::(_updateState) Task=`f4e94216-024b-465e-a0b0-159113279b56`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:05:40,675::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:05:40,677::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:05:40,677::task::1185::TaskManager.Task::(prepare) Task=`f4e94216-024b-465e-a0b0-159113279b56`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:05:40,678::task::595::TaskManager.Task::(_updateState) Task=`f4e94216-024b-465e-a0b0-159113279b56`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:05:40,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:05:40,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:05:40,679::task::990::TaskManager.Task::(_decref) Task=`f4e94216-024b-465e-a0b0-159113279b56`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:05:41,438::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-34::DEBUG::2014-08-21 11:05:41,440::task::595::TaskManager.Task::(_updateState) Task=`03ddc909-cb8c-4eb8-ac0f-cd79c1217cc1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:05:41,451::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:05:41,452::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f4f86341-416b-48eb-bc66-6e1bed56f533`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:05:41,452::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:05:41,453::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:05:41,453::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f4f86341-416b-48eb-bc66-6e1bed56f533`::Granted request
>Thread-34::DEBUG::2014-08-21 11:05:41,454::task::827::TaskManager.Task::(resourceAcquired) Task=`03ddc909-cb8c-4eb8-ac0f-cd79c1217cc1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:05:41,454::task::990::TaskManager.Task::(_decref) Task=`03ddc909-cb8c-4eb8-ac0f-cd79c1217cc1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:05:41,466::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:41,466::task::1185::TaskManager.Task::(prepare) Task=`03ddc909-cb8c-4eb8-ac0f-cd79c1217cc1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896129536', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:41,467::task::595::TaskManager.Task::(_updateState) Task=`03ddc909-cb8c-4eb8-ac0f-cd79c1217cc1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:05:41,467::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:05:41,468::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:05:41,468::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:05:41,471::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:05:41,471::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:05:41,472::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:05:41,472::task::990::TaskManager.Task::(_decref) Task=`03ddc909-cb8c-4eb8-ac0f-cd79c1217cc1`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:05:42,138::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:05:42,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.30826 s, 162 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:05:42,496::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000489048 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:45,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:05:52,460::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-26::DEBUG::2014-08-21 11:05:52,473::task::595::TaskManager.Task::(_updateState) Task=`5e0abd3c-24f6-4f51-be06-392f6f080b2c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:05:52,477::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:05:52,483::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:05:52,486::task::1185::TaskManager.Task::(prepare) Task=`5e0abd3c-24f6-4f51-be06-392f6f080b2c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:05:52,489::task::595::TaskManager.Task::(_updateState) Task=`5e0abd3c-24f6-4f51-be06-392f6f080b2c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:05:52,493::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:05:52,496::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:05:52,500::task::990::TaskManager.Task::(_decref) Task=`5e0abd3c-24f6-4f51-be06-392f6f080b2c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:05:52,519::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 11:05:52,525::task::595::TaskManager.Task::(_updateState) Task=`bf16f05c-1ca4-45da-a462-bd16f36e0e67`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:05:52,529::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:05:52,539::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c6f62bf9-fe7a-4a6d-ab35-90e78bcda57f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:05:52,547::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:05:52,555::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:05:52,559::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c6f62bf9-fe7a-4a6d-ab35-90e78bcda57f`::Granted request
>Thread-34::DEBUG::2014-08-21 11:05:52,570::task::827::TaskManager.Task::(resourceAcquired) Task=`bf16f05c-1ca4-45da-a462-bd16f36e0e67`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:05:52,576::task::990::TaskManager.Task::(_decref) Task=`bf16f05c-1ca4-45da-a462-bd16f36e0e67`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:05:52,688::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:52,718::task::1185::TaskManager.Task::(prepare) Task=`bf16f05c-1ca4-45da-a462-bd16f36e0e67`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896653824', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:05:52,719::task::595::TaskManager.Task::(_updateState) Task=`bf16f05c-1ca4-45da-a462-bd16f36e0e67`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:05:52,719::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:05:52,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:05:52,721::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:05:52,730::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:05:52,731::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:05:52,731::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:05:52,732::task::990::TaskManager.Task::(_decref) Task=`bf16f05c-1ca4-45da-a462-bd16f36e0e67`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:05:52,765::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:05:52,905::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0084274 s, 59.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:53,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.337304 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:55,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:05:55,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0794697 s, 12.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:05:57,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:05:58,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.670264 s, 1.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:05:58,538::task::595::TaskManager.Task::(_updateState) Task=`e25fb082-ed6b-43a1-8205-42f2a839ff4c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:05:58,538::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:05:58,539::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0084274', 'lastCheck': '5.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:05:58,539::task::1185::TaskManager.Task::(prepare) Task=`e25fb082-ed6b-43a1-8205-42f2a839ff4c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0084274', 'lastCheck': '5.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:05:58,540::task::595::TaskManager.Task::(_updateState) Task=`e25fb082-ed6b-43a1-8205-42f2a839ff4c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:05:58,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:05:58,540::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:05:58,541::task::990::TaskManager.Task::(_decref) Task=`e25fb082-ed6b-43a1-8205-42f2a839ff4c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:06:09,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:06:09,705::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Thread-13::DEBUG::2014-08-21 11:06:09,739::task::595::TaskManager.Task::(_updateState) Task=`3d2f56e6-c840-44c8-9a93-2afa200b8e27`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:06:09,754::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:06:09,759::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:06:09,778::task::1185::TaskManager.Task::(prepare) Task=`3d2f56e6-c840-44c8-9a93-2afa200b8e27`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:06:09,786::task::595::TaskManager.Task::(_updateState) Task=`3d2f56e6-c840-44c8-9a93-2afa200b8e27`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:06:09,796::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:06:09,826::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:06:09,839::task::990::TaskManager.Task::(_decref) Task=`3d2f56e6-c840-44c8-9a93-2afa200b8e27`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:06:10,038::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Thread-34::DEBUG::2014-08-21 11:06:10,042::task::595::TaskManager.Task::(_updateState) Task=`064a741c-3c1a-4cb3-b60a-bb60a617edc4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:06:10,045::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:06:10,048::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5022d217-8652-4618-88ab-ae8f6947c1bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:06:10,050::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:06:10,052::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:06:10,054::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5022d217-8652-4618-88ab-ae8f6947c1bd`::Granted request
>Thread-34::DEBUG::2014-08-21 11:06:10,057::task::827::TaskManager.Task::(resourceAcquired) Task=`064a741c-3c1a-4cb3-b60a-bb60a617edc4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:06:10,058::task::990::TaskManager.Task::(_decref) Task=`064a741c-3c1a-4cb3-b60a-bb60a617edc4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:06:10,094::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:06:10,096::task::1185::TaskManager.Task::(prepare) Task=`064a741c-3c1a-4cb3-b60a-bb60a617edc4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896457216', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:06:10,098::task::595::TaskManager.Task::(_updateState) Task=`064a741c-3c1a-4cb3-b60a-bb60a617edc4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:06:10,099::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:06:10,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:06:10,104::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:06:10,108::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:06:10,110::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:06:10,111::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:06:10,114::task::990::TaskManager.Task::(_decref) Task=`064a741c-3c1a-4cb3-b60a-bb60a617edc4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:06:10,114::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:06:21,737::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0707043 s, 7.0 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:06:22,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 12.5477 s, 81.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:06:24,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:06:24,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0560453 s, 18.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:06:26,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:06:29,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.8485 s, 359 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:06:31,574::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-13::DEBUG::2014-08-21 11:06:31,579::task::595::TaskManager.Task::(_updateState) Task=`e4b063ff-ae31-47cf-a7ba-320edb437c19`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:06:31,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:06:31,581::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:06:31,581::task::1185::TaskManager.Task::(prepare) Task=`e4b063ff-ae31-47cf-a7ba-320edb437c19`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:06:31,581::task::595::TaskManager.Task::(_updateState) Task=`e4b063ff-ae31-47cf-a7ba-320edb437c19`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:06:31,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:06:31,582::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:06:31,582::task::990::TaskManager.Task::(_decref) Task=`e4b063ff-ae31-47cf-a7ba-320edb437c19`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:06:31,587::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-34::DEBUG::2014-08-21 11:06:31,588::task::595::TaskManager.Task::(_updateState) Task=`58dc74f6-ca77-4718-b951-ac163fc3dd74`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:06:31,588::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:06:31,589::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a57bb595-9de0-4934-a8dc-e2fa3e3f13ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:06:31,589::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:06:31,590::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:06:31,590::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a57bb595-9de0-4934-a8dc-e2fa3e3f13ab`::Granted request
>Thread-34::DEBUG::2014-08-21 11:06:31,591::task::827::TaskManager.Task::(resourceAcquired) Task=`58dc74f6-ca77-4718-b951-ac163fc3dd74`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:06:31,591::task::990::TaskManager.Task::(_decref) Task=`58dc74f6-ca77-4718-b951-ac163fc3dd74`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:06:31,597::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:06:31,598::task::1185::TaskManager.Task::(prepare) Task=`58dc74f6-ca77-4718-b951-ac163fc3dd74`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896850432', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:06:31,598::task::595::TaskManager.Task::(_updateState) Task=`58dc74f6-ca77-4718-b951-ac163fc3dd74`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:06:31,598::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:06:31,599::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:06:31,599::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:06:31,600::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:06:31,600::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:06:31,600::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:06:31,602::task::990::TaskManager.Task::(_decref) Task=`58dc74f6-ca77-4718-b951-ac163fc3dd74`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:06:31,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:06:32,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.273715 s, 3.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:06:32,339::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:06:32,364::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00124622 s, 400 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:06:34,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:06:35,733::task::595::TaskManager.Task::(_updateState) Task=`dc352a6b-523b-4280-b45a-febae871cb39`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:06:35,734::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:06:35,734::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00124622', 'lastCheck': '3.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:06:35,734::task::1185::TaskManager.Task::(prepare) Task=`dc352a6b-523b-4280-b45a-febae871cb39`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00124622', 'lastCheck': '3.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:06:35,735::task::595::TaskManager.Task::(_updateState) Task=`dc352a6b-523b-4280-b45a-febae871cb39`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:06:35,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:06:35,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:06:35,736::task::990::TaskManager.Task::(_decref) Task=`dc352a6b-523b-4280-b45a-febae871cb39`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:06:38,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.34926 s, 235 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:06:40,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:06:41,781::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-13::DEBUG::2014-08-21 11:06:41,795::task::595::TaskManager.Task::(_updateState) Task=`52a28768-9477-4c44-91ea-a71837289e5a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:06:41,796::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:06:41,813::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:06:41,814::task::1185::TaskManager.Task::(prepare) Task=`52a28768-9477-4c44-91ea-a71837289e5a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:06:41,814::task::595::TaskManager.Task::(_updateState) Task=`52a28768-9477-4c44-91ea-a71837289e5a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:06:41,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:06:41,815::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:06:41,815::task::990::TaskManager.Task::(_decref) Task=`52a28768-9477-4c44-91ea-a71837289e5a`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:06:43,567::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:06:45,049::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-34::DEBUG::2014-08-21 11:06:45,369::task::595::TaskManager.Task::(_updateState) Task=`4d3f4903-ef36-4410-96e0-7691fdede7bb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:06:45,370::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:06:45,390::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1607e8dd-e657-462a-9191-811c7b2aa3d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:06:45,390::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:06:45,391::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:06:45,674::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1607e8dd-e657-462a-9191-811c7b2aa3d5`::Granted request
>Thread-34::DEBUG::2014-08-21 11:06:45,675::task::827::TaskManager.Task::(resourceAcquired) Task=`4d3f4903-ef36-4410-96e0-7691fdede7bb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:06:45,675::task::990::TaskManager.Task::(_decref) Task=`4d3f4903-ef36-4410-96e0-7691fdede7bb`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:06:45,720::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0183912 s, 27.1 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:06:46,757::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:06:46,758::task::1185::TaskManager.Task::(prepare) Task=`4d3f4903-ef36-4410-96e0-7691fdede7bb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:06:46,759::task::595::TaskManager.Task::(_updateState) Task=`4d3f4903-ef36-4410-96e0-7691fdede7bb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:06:46,759::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:06:46,960::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:06:46,996::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:06:46,997::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:06:46,997::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:06:47,536::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:06:47,537::task::990::TaskManager.Task::(_decref) Task=`4d3f4903-ef36-4410-96e0-7691fdede7bb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:06:49,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.03277 s, 127 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:06:51,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:06:52,992::task::595::TaskManager.Task::(_updateState) Task=`ff1d7c68-7472-473b-a694-57c75ca4ae17`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:06:52,994::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:06:52,995::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0183912', 'lastCheck': '6.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:06:52,995::task::1185::TaskManager.Task::(prepare) Task=`ff1d7c68-7472-473b-a694-57c75ca4ae17`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0183912', 'lastCheck': '6.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:06:52,996::task::595::TaskManager.Task::(_updateState) Task=`ff1d7c68-7472-473b-a694-57c75ca4ae17`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:06:52,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:06:52,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:06:53,008::task::990::TaskManager.Task::(_decref) Task=`ff1d7c68-7472-473b-a694-57c75ca4ae17`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:06:53,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.634985 s, 1.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:06:55,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:07:03,405::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-13::DEBUG::2014-08-21 11:07:03,408::task::595::TaskManager.Task::(_updateState) Task=`0d41f01d-6035-4adb-9e3c-0e4a409f7cc8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:07:03,409::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:07:03,410::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:07:03,410::task::1185::TaskManager.Task::(prepare) Task=`0d41f01d-6035-4adb-9e3c-0e4a409f7cc8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:07:03,411::task::595::TaskManager.Task::(_updateState) Task=`0d41f01d-6035-4adb-9e3c-0e4a409f7cc8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:07:03,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:07:03,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:07:03,428::task::990::TaskManager.Task::(_decref) Task=`0d41f01d-6035-4adb-9e3c-0e4a409f7cc8`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:07:06,901::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:07:07,453::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0348002 s, 14.3 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:07:07,692::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-34::DEBUG::2014-08-21 11:07:07,890::task::595::TaskManager.Task::(_updateState) Task=`fbfcdc5f-9f93-4d2f-8e00-08dbd124971a`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:07:07,891::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:07:07,892::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2dddd4f4-fb06-40ed-b08c-deb00a5f72a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:07:07,893::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:07:07,945::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:07:07,945::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2dddd4f4-fb06-40ed-b08c-deb00a5f72a4`::Granted request
>Thread-34::DEBUG::2014-08-21 11:07:07,947::task::827::TaskManager.Task::(resourceAcquired) Task=`fbfcdc5f-9f93-4d2f-8e00-08dbd124971a`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:07:07,964::task::990::TaskManager.Task::(_decref) Task=`fbfcdc5f-9f93-4d2f-8e00-08dbd124971a`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:07:08,071::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:08,072::task::1185::TaskManager.Task::(prepare) Task=`fbfcdc5f-9f93-4d2f-8e00-08dbd124971a`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:08,072::task::595::TaskManager.Task::(_updateState) Task=`fbfcdc5f-9f93-4d2f-8e00-08dbd124971a`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:07:08,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:07:08,079::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:07:08,100::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:07:08,115::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:07:08,116::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:07:08,116::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:07:08,188::task::990::TaskManager.Task::(_decref) Task=`fbfcdc5f-9f93-4d2f-8e00-08dbd124971a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:07:08,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 11.845 s, 86.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:10,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:10,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100703 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:12,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:12,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.129827 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:14,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:07:16,570::task::595::TaskManager.Task::(_updateState) Task=`c7067ef6-1c47-44b8-9580-a331bad03225`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:07:16,571::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:07:16,572::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0348002', 'lastCheck': '8.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:07:16,693::task::1185::TaskManager.Task::(prepare) Task=`c7067ef6-1c47-44b8-9580-a331bad03225`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0348002', 'lastCheck': '8.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:07:16,814::task::595::TaskManager.Task::(_updateState) Task=`c7067ef6-1c47-44b8-9580-a331bad03225`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:07:16,823::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:07:16,881::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:07:16,895::task::990::TaskManager.Task::(_decref) Task=`c7067ef6-1c47-44b8-9580-a331bad03225`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:07:18,419::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-13::DEBUG::2014-08-21 11:07:18,420::task::595::TaskManager.Task::(_updateState) Task=`de1cbede-6612-4888-901c-17b85efdec74`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:07:18,421::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:07:18,422::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:07:18,423::task::1185::TaskManager.Task::(prepare) Task=`de1cbede-6612-4888-901c-17b85efdec74`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:07:18,423::task::595::TaskManager.Task::(_updateState) Task=`de1cbede-6612-4888-901c-17b85efdec74`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:07:18,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:07:18,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:07:18,425::task::990::TaskManager.Task::(_decref) Task=`de1cbede-6612-4888-901c-17b85efdec74`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:07:18,448::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-15::DEBUG::2014-08-21 11:07:18,449::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:07:18,475::task::595::TaskManager.Task::(_updateState) Task=`32fcc60d-811a-4d2f-ae49-7983bd939c31`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:07:18,533::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 11:07:18,536::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000407962 s, 1.2 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:07:18,575::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`607af2f9-a728-46a9-a2ea-54019f0e9316`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:07:18,577::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:07:18,700::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:07:18,703::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`607af2f9-a728-46a9-a2ea-54019f0e9316`::Granted request
>Thread-34::DEBUG::2014-08-21 11:07:18,710::task::827::TaskManager.Task::(resourceAcquired) Task=`32fcc60d-811a-4d2f-ae49-7983bd939c31`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:07:18,724::task::990::TaskManager.Task::(_decref) Task=`32fcc60d-811a-4d2f-ae49-7983bd939c31`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:07:18,754::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:18,755::task::1185::TaskManager.Task::(prepare) Task=`32fcc60d-811a-4d2f-ae49-7983bd939c31`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:18,755::task::595::TaskManager.Task::(_updateState) Task=`32fcc60d-811a-4d2f-ae49-7983bd939c31`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:07:18,756::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:07:18,756::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:07:18,757::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:07:18,757::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:07:18,757::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:07:18,758::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:07:18,758::task::990::TaskManager.Task::(_decref) Task=`32fcc60d-811a-4d2f-ae49-7983bd939c31`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:07:18,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.21781 s, 841 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:20,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:21,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.80842 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:23,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:24,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0560944 s, 18.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:26,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:26,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178852 s, 5.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:28,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:28,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0634716 s, 16.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:07:28,758::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:07:28,772::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000552198 s, 902 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:07:28,807::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-13::DEBUG::2014-08-21 11:07:28,808::task::595::TaskManager.Task::(_updateState) Task=`152f36c0-ab8b-41da-a72c-aa42e9c8dc3f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:07:28,808::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:07:28,809::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:07:28,809::task::1185::TaskManager.Task::(prepare) Task=`152f36c0-ab8b-41da-a72c-aa42e9c8dc3f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:07:28,809::task::595::TaskManager.Task::(_updateState) Task=`152f36c0-ab8b-41da-a72c-aa42e9c8dc3f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:07:28,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:07:28,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:07:28,810::task::990::TaskManager.Task::(_decref) Task=`152f36c0-ab8b-41da-a72c-aa42e9c8dc3f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:07:28,814::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-34::DEBUG::2014-08-21 11:07:28,815::task::595::TaskManager.Task::(_updateState) Task=`0c4ed5d7-e09e-43aa-8f67-2dd07b2f3493`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:07:28,815::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:07:28,815::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`202b6b84-17d5-4483-b317-2ca86739bfe0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:07:28,816::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:07:28,816::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:07:28,816::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`202b6b84-17d5-4483-b317-2ca86739bfe0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:07:28,817::task::827::TaskManager.Task::(resourceAcquired) Task=`0c4ed5d7-e09e-43aa-8f67-2dd07b2f3493`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:07:28,817::task::990::TaskManager.Task::(_decref) Task=`0c4ed5d7-e09e-43aa-8f67-2dd07b2f3493`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:07:28,821::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:28,821::task::1185::TaskManager.Task::(prepare) Task=`0c4ed5d7-e09e-43aa-8f67-2dd07b2f3493`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896064000', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:28,821::task::595::TaskManager.Task::(_updateState) Task=`0c4ed5d7-e09e-43aa-8f67-2dd07b2f3493`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:07:28,822::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:07:28,822::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:07:28,822::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:07:28,823::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:07:28,823::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:07:28,823::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:07:28,823::task::990::TaskManager.Task::(_decref) Task=`0c4ed5d7-e09e-43aa-8f67-2dd07b2f3493`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:07:30,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:30,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561328 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:32,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:07:32,976::task::595::TaskManager.Task::(_updateState) Task=`6bfb1809-a15e-4bb4-bc76-cd3895b9aaef`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:07:32,977::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:07:32,978::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552198', 'lastCheck': '4.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:07:32,978::task::1185::TaskManager.Task::(prepare) Task=`6bfb1809-a15e-4bb4-bc76-cd3895b9aaef`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552198', 'lastCheck': '4.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:07:32,979::task::595::TaskManager.Task::(_updateState) Task=`6bfb1809-a15e-4bb4-bc76-cd3895b9aaef`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:07:32,980::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:07:32,980::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:07:32,980::task::990::TaskManager.Task::(_decref) Task=`6bfb1809-a15e-4bb4-bc76-cd3895b9aaef`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:07:33,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.245935 s, 4.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:35,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:35,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0686396 s, 14.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:37,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:37,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0573464 s, 17.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:07:38,792::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:07:38,811::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00187119 s, 266 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:07:38,842::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-13::DEBUG::2014-08-21 11:07:38,843::task::595::TaskManager.Task::(_updateState) Task=`ed84c5b5-2c59-4267-b7ce-af2c997044d7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:07:38,844::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:07:38,844::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:07:38,844::task::1185::TaskManager.Task::(prepare) Task=`ed84c5b5-2c59-4267-b7ce-af2c997044d7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:07:38,845::task::595::TaskManager.Task::(_updateState) Task=`ed84c5b5-2c59-4267-b7ce-af2c997044d7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:07:38,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:07:38,845::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:07:38,845::task::990::TaskManager.Task::(_decref) Task=`ed84c5b5-2c59-4267-b7ce-af2c997044d7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:07:38,851::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 11:07:38,851::task::595::TaskManager.Task::(_updateState) Task=`03698106-83a9-49c5-986e-f4d2c6a8c0ec`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:07:38,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:07:38,852::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f9861fbd-2fd6-4796-a985-c9e35f3e041a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:07:38,853::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:07:38,853::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:07:38,853::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f9861fbd-2fd6-4796-a985-c9e35f3e041a`::Granted request
>Thread-34::DEBUG::2014-08-21 11:07:38,854::task::827::TaskManager.Task::(resourceAcquired) Task=`03698106-83a9-49c5-986e-f4d2c6a8c0ec`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:07:38,854::task::990::TaskManager.Task::(_decref) Task=`03698106-83a9-49c5-986e-f4d2c6a8c0ec`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:07:38,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:38,859::task::1185::TaskManager.Task::(prepare) Task=`03698106-83a9-49c5-986e-f4d2c6a8c0ec`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:38,859::task::595::TaskManager.Task::(_updateState) Task=`03698106-83a9-49c5-986e-f4d2c6a8c0ec`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:07:38,859::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:07:38,859::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:07:38,860::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:07:38,860::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:07:38,860::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:07:38,861::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:07:38,861::task::990::TaskManager.Task::(_decref) Task=`03698106-83a9-49c5-986e-f4d2c6a8c0ec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:07:39,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:39,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0607297 s, 16.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:41,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:46,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.70142 s, 218 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:48,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:07:50,656::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-26::DEBUG::2014-08-21 11:07:50,834::task::595::TaskManager.Task::(_updateState) Task=`ae862bd5-be02-4b82-8451-2c4f0cbd2fdf`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:07:50,896::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:07:50,924::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:07:51,078::task::1185::TaskManager.Task::(prepare) Task=`ae862bd5-be02-4b82-8451-2c4f0cbd2fdf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:07:51,082::task::595::TaskManager.Task::(_updateState) Task=`ae862bd5-be02-4b82-8451-2c4f0cbd2fdf`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:07:51,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:07:51,233::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:07:51,746::task::990::TaskManager.Task::(_decref) Task=`ae862bd5-be02-4b82-8451-2c4f0cbd2fdf`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:07:52,507::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:07:53,103::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-34::DEBUG::2014-08-21 11:07:53,105::task::595::TaskManager.Task::(_updateState) Task=`3dc78e4d-c8c1-43b6-a9f1-e253b93160b7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:07:53,105::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:07:53,158::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1d431ec-2460-47a6-b9d9-2d2d60a7594e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:07:53,159::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:07:53,160::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:07:53,161::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1d431ec-2460-47a6-b9d9-2d2d60a7594e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:07:53,313::task::827::TaskManager.Task::(resourceAcquired) Task=`3dc78e4d-c8c1-43b6-a9f1-e253b93160b7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:07:53,335::task::990::TaskManager.Task::(_decref) Task=`3dc78e4d-c8c1-43b6-a9f1-e253b93160b7`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:07:53,680::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0598659 s, 8.3 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:07:53,799::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:53,799::task::1185::TaskManager.Task::(prepare) Task=`3dc78e4d-c8c1-43b6-a9f1-e253b93160b7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:07:53,800::task::595::TaskManager.Task::(_updateState) Task=`3dc78e4d-c8c1-43b6-a9f1-e253b93160b7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:07:53,800::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:07:53,800::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:07:53,801::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:07:53,858::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:07:53,858::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:07:53,859::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:07:53,859::task::990::TaskManager.Task::(_decref) Task=`3dc78e4d-c8c1-43b6-a9f1-e253b93160b7`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:07:54,164::task::595::TaskManager.Task::(_updateState) Task=`2239d411-0686-4c4f-96e8-141ac954053d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:07:54,164::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:07:54,165::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00187119', 'lastCheck': '15.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:07:54,165::task::1185::TaskManager.Task::(prepare) Task=`2239d411-0686-4c4f-96e8-141ac954053d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00187119', 'lastCheck': '15.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:07:54,243::task::595::TaskManager.Task::(_updateState) Task=`2239d411-0686-4c4f-96e8-141ac954053d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:07:54,244::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:07:54,244::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:07:54,244::task::990::TaskManager.Task::(_decref) Task=`2239d411-0686-4c4f-96e8-141ac954053d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:07:56,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.74842 s, 178 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:07:58,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:07:58,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564056 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:01,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:02,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.851089 s, 1.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:08:04,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:08:04,274::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00047962 s, 1.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:08:04,410::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-26::DEBUG::2014-08-21 11:08:04,412::task::595::TaskManager.Task::(_updateState) Task=`b2ca6856-0654-4502-9c52-3ac609516536`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:08:04,413::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:08:04,414::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:08:04,415::task::1185::TaskManager.Task::(prepare) Task=`b2ca6856-0654-4502-9c52-3ac609516536`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:08:04,415::task::595::TaskManager.Task::(_updateState) Task=`b2ca6856-0654-4502-9c52-3ac609516536`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:08:04,415::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:08:04,416::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:08:04,416::task::990::TaskManager.Task::(_decref) Task=`b2ca6856-0654-4502-9c52-3ac609516536`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:08:04,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-34::DEBUG::2014-08-21 11:08:04,423::task::595::TaskManager.Task::(_updateState) Task=`9d5a2dc4-c2b6-4dae-8fca-4f0f71b9bae9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:08:04,424::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:08:04,425::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`116ae934-d1b2-4ff7-a2a5-3a36bfd961cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:08:04,425::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:08:04,426::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:08:04,426::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`116ae934-d1b2-4ff7-a2a5-3a36bfd961cd`::Granted request
>Thread-34::DEBUG::2014-08-21 11:08:04,427::task::827::TaskManager.Task::(resourceAcquired) Task=`9d5a2dc4-c2b6-4dae-8fca-4f0f71b9bae9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:08:04,427::task::990::TaskManager.Task::(_decref) Task=`9d5a2dc4-c2b6-4dae-8fca-4f0f71b9bae9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:08:04,435::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:04,436::task::1185::TaskManager.Task::(prepare) Task=`9d5a2dc4-c2b6-4dae-8fca-4f0f71b9bae9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:04,436::task::595::TaskManager.Task::(_updateState) Task=`9d5a2dc4-c2b6-4dae-8fca-4f0f71b9bae9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:08:04,437::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:08:04,437::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:08:04,438::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:08:04,438::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:08:04,439::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:08:04,439::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:08:04,440::task::990::TaskManager.Task::(_decref) Task=`9d5a2dc4-c2b6-4dae-8fca-4f0f71b9bae9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:08:04,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:04,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0669046 s, 15.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:07,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:07,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111988 s, 9.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:09,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:10,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.337774 s, 3.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:08:10,826::task::595::TaskManager.Task::(_updateState) Task=`442d6d6d-cef8-4fa8-b800-9dfd8273beae`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:08:10,827::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:08:10,827::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047962', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:08:10,827::task::1185::TaskManager.Task::(prepare) Task=`442d6d6d-cef8-4fa8-b800-9dfd8273beae`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047962', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:08:10,828::task::595::TaskManager.Task::(_updateState) Task=`442d6d6d-cef8-4fa8-b800-9dfd8273beae`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:08:10,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:08:10,828::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:08:10,828::task::990::TaskManager.Task::(_decref) Task=`442d6d6d-cef8-4fa8-b800-9dfd8273beae`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:08:12,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:08:16,138::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-26::DEBUG::2014-08-21 11:08:16,231::task::595::TaskManager.Task::(_updateState) Task=`eda42889-d765-4f29-a1f9-431ef77bdc87`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:08:16,234::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:08:16,240::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:08:16,242::task::1185::TaskManager.Task::(prepare) Task=`eda42889-d765-4f29-a1f9-431ef77bdc87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:08:16,247::task::595::TaskManager.Task::(_updateState) Task=`eda42889-d765-4f29-a1f9-431ef77bdc87`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:08:16,249::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:08:16,251::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:08:16,256::task::990::TaskManager.Task::(_decref) Task=`eda42889-d765-4f29-a1f9-431ef77bdc87`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:08:16,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:08:16,298::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00158461 s, 314 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:08:16,307::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfca9aa]
>Thread-34::DEBUG::2014-08-21 11:08:16,314::task::595::TaskManager.Task::(_updateState) Task=`967d0d28-0eaa-4b2d-b1d7-6ba278805e3e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:08:16,318::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:08:16,324::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a35692e9-93dd-46f7-bc16-c8a0c22dfe75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:08:16,326::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:08:16,331::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:08:16,332::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a35692e9-93dd-46f7-bc16-c8a0c22dfe75`::Granted request
>Thread-34::DEBUG::2014-08-21 11:08:16,335::task::827::TaskManager.Task::(resourceAcquired) Task=`967d0d28-0eaa-4b2d-b1d7-6ba278805e3e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:08:16,336::task::990::TaskManager.Task::(_decref) Task=`967d0d28-0eaa-4b2d-b1d7-6ba278805e3e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:08:16,356::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:16,357::task::1185::TaskManager.Task::(prepare) Task=`967d0d28-0eaa-4b2d-b1d7-6ba278805e3e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896522752', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:16,358::task::595::TaskManager.Task::(_updateState) Task=`967d0d28-0eaa-4b2d-b1d7-6ba278805e3e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:08:16,359::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:08:16,360::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:08:16,362::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:08:16,363::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:08:16,364::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:08:16,365::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:08:16,366::task::990::TaskManager.Task::(_decref) Task=`967d0d28-0eaa-4b2d-b1d7-6ba278805e3e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:08:16,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.98029 s, 257 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:18,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:19,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.34605 s, 761 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:21,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:22,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0831775 s, 12.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:24,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:24,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460442 s, 22.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:26,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:08:26,852::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-13::DEBUG::2014-08-21 11:08:26,895::task::595::TaskManager.Task::(_updateState) Task=`e3ff0ae6-27a0-4327-981a-6ec508064320`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:08:26,901::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:08:26,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00158461', 'lastCheck': '10.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:08:26,910::task::595::TaskManager.Task::(_updateState) Task=`541116e0-8510-436d-b5aa-58dd6c78c554`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 11:08:26,950::task::1185::TaskManager.Task::(prepare) Task=`e3ff0ae6-27a0-4327-981a-6ec508064320`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00158461', 'lastCheck': '10.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:08:26,974::task::595::TaskManager.Task::(_updateState) Task=`e3ff0ae6-27a0-4327-981a-6ec508064320`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:08:26,984::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::INFO::2014-08-21 11:08:26,988::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::DEBUG::2014-08-21 11:08:26,993::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::INFO::2014-08-21 11:08:27,041::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:08:27,066::task::990::TaskManager.Task::(_decref) Task=`e3ff0ae6-27a0-4327-981a-6ec508064320`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:08:27,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:08:27,151::task::1185::TaskManager.Task::(prepare) Task=`541116e0-8510-436d-b5aa-58dd6c78c554`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:08:27,329::task::595::TaskManager.Task::(_updateState) Task=`541116e0-8510-436d-b5aa-58dd6c78c554`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 11:08:27,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000840099 s, 593 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:08:27,330::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:08:27,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:08:27,343::task::990::TaskManager.Task::(_decref) Task=`541116e0-8510-436d-b5aa-58dd6c78c554`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:08:27,619::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 11:08:27,620::task::595::TaskManager.Task::(_updateState) Task=`4d9dd7fd-f031-444d-868c-6d4e6c356354`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:08:27,621::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:08:27,730::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e38bc9bf-63a8-4d61-bc22-2f6310cb2580`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:08:27,731::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:08:27,732::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:08:27,732::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e38bc9bf-63a8-4d61-bc22-2f6310cb2580`::Granted request
>Thread-34::DEBUG::2014-08-21 11:08:27,793::task::827::TaskManager.Task::(resourceAcquired) Task=`4d9dd7fd-f031-444d-868c-6d4e6c356354`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:08:27,793::task::990::TaskManager.Task::(_decref) Task=`4d9dd7fd-f031-444d-868c-6d4e6c356354`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:08:27,831::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:27,831::task::1185::TaskManager.Task::(prepare) Task=`4d9dd7fd-f031-444d-868c-6d4e6c356354`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:27,832::task::595::TaskManager.Task::(_updateState) Task=`4d9dd7fd-f031-444d-868c-6d4e6c356354`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:08:27,832::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:08:27,833::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:08:27,834::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:08:27,835::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:08:27,835::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:08:27,836::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:08:27,836::task::990::TaskManager.Task::(_decref) Task=`4d9dd7fd-f031-444d-868c-6d4e6c356354`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:08:28,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.52383 s, 672 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:30,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:30,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0930955 s, 11.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:32,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:32,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0843114 s, 12.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:34,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:35,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.507564 s, 2.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:08:37,667::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:08:37,686::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00145408 s, 342 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:37,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:37,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0976057 s, 10.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:08:38,065::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-13::DEBUG::2014-08-21 11:08:38,066::task::595::TaskManager.Task::(_updateState) Task=`ff906622-5286-4b97-825d-12298261612b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:08:38,067::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:08:38,067::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:08:38,068::task::1185::TaskManager.Task::(prepare) Task=`ff906622-5286-4b97-825d-12298261612b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:08:38,068::task::595::TaskManager.Task::(_updateState) Task=`ff906622-5286-4b97-825d-12298261612b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:08:38,068::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:08:38,069::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:08:38,069::task::990::TaskManager.Task::(_decref) Task=`ff906622-5286-4b97-825d-12298261612b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:08:38,075::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-34::DEBUG::2014-08-21 11:08:38,076::task::595::TaskManager.Task::(_updateState) Task=`93d42a80-d61a-4be1-ae9c-080e4b7acc32`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:08:38,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:08:38,077::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`82b33f92-b2dd-4605-ac42-9f95ebeea231`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:08:38,077::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:08:38,078::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:08:38,078::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`82b33f92-b2dd-4605-ac42-9f95ebeea231`::Granted request
>Thread-34::DEBUG::2014-08-21 11:08:38,078::task::827::TaskManager.Task::(resourceAcquired) Task=`93d42a80-d61a-4be1-ae9c-080e4b7acc32`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:08:38,079::task::990::TaskManager.Task::(_decref) Task=`93d42a80-d61a-4be1-ae9c-080e4b7acc32`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:08:38,086::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:38,087::task::1185::TaskManager.Task::(prepare) Task=`93d42a80-d61a-4be1-ae9c-080e4b7acc32`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:38,088::task::595::TaskManager.Task::(_updateState) Task=`93d42a80-d61a-4be1-ae9c-080e4b7acc32`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:08:38,088::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:08:38,088::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:08:38,089::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:08:38,090::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:08:38,090::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:08:38,090::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:08:38,091::task::990::TaskManager.Task::(_decref) Task=`93d42a80-d61a-4be1-ae9c-080e4b7acc32`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:08:39,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:41,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.983389 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:43,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:43,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102694 s, 10.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:08:43,621::task::595::TaskManager.Task::(_updateState) Task=`86d6d0a7-4983-4470-86d2-8464fc11d4a5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:08:43,622::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:08:43,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145408', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:08:43,622::task::1185::TaskManager.Task::(prepare) Task=`86d6d0a7-4983-4470-86d2-8464fc11d4a5`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145408', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:08:43,622::task::595::TaskManager.Task::(_updateState) Task=`86d6d0a7-4983-4470-86d2-8464fc11d4a5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:08:43,623::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:08:43,623::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:08:43,623::task::990::TaskManager.Task::(_decref) Task=`86d6d0a7-4983-4470-86d2-8464fc11d4a5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:08:45,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:46,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.607127 s, 1.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:08:47,710::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:08:47,740::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00125804 s, 396 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:08:48,108::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-13::DEBUG::2014-08-21 11:08:48,110::task::595::TaskManager.Task::(_updateState) Task=`a7f43295-a7f7-4ba6-b1bd-7fd440503b84`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:08:48,110::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:08:48,111::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:08:48,111::task::1185::TaskManager.Task::(prepare) Task=`a7f43295-a7f7-4ba6-b1bd-7fd440503b84`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:08:48,111::task::595::TaskManager.Task::(_updateState) Task=`a7f43295-a7f7-4ba6-b1bd-7fd440503b84`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:08:48,111::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:08:48,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:08:48,112::task::990::TaskManager.Task::(_decref) Task=`a7f43295-a7f7-4ba6-b1bd-7fd440503b84`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:08:48,117::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-34::DEBUG::2014-08-21 11:08:48,119::task::595::TaskManager.Task::(_updateState) Task=`ce9b4b09-3380-41bb-baf7-e0fc6076e023`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:08:48,119::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:08:48,121::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4074fd56-9165-4c74-be31-fbc3efe3c163`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:08:48,121::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:08:48,122::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:08:48,122::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4074fd56-9165-4c74-be31-fbc3efe3c163`::Granted request
>Thread-34::DEBUG::2014-08-21 11:08:48,123::task::827::TaskManager.Task::(resourceAcquired) Task=`ce9b4b09-3380-41bb-baf7-e0fc6076e023`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:08:48,123::task::990::TaskManager.Task::(_decref) Task=`ce9b4b09-3380-41bb-baf7-e0fc6076e023`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:08:48,129::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:48,130::task::1185::TaskManager.Task::(prepare) Task=`ce9b4b09-3380-41bb-baf7-e0fc6076e023`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:48,130::task::595::TaskManager.Task::(_updateState) Task=`ce9b4b09-3380-41bb-baf7-e0fc6076e023`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:08:48,131::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:08:48,132::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:08:48,132::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:08:48,132::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:08:48,133::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:08:48,133::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:08:48,133::task::990::TaskManager.Task::(_decref) Task=`ce9b4b09-3380-41bb-baf7-e0fc6076e023`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:08:48,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:48,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0698703 s, 14.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:50,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:50,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0747404 s, 13.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:52,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:52,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.199906 s, 5.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:54,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:08:55,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.259584 s, 3.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:57,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:08:57,764::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:08:57,910::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:08:57,917::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:08:57,937::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-15::DEBUG::2014-08-21 11:08:57,946::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:08:57,948::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:08:57,949::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 11:08:58,016::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:08:58,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00044899 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:08:58,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.379791 s, 2.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:08:58,153::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-13::DEBUG::2014-08-21 11:08:58,155::task::595::TaskManager.Task::(_updateState) Task=`2817e5ab-cfb8-4a89-9770-6d7e70381a02`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:08:58,156::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:08:58,156::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:08:58,157::task::1185::TaskManager.Task::(prepare) Task=`2817e5ab-cfb8-4a89-9770-6d7e70381a02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:08:58,157::task::595::TaskManager.Task::(_updateState) Task=`2817e5ab-cfb8-4a89-9770-6d7e70381a02`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:08:58,157::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:08:58,157::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:08:58,157::task::990::TaskManager.Task::(_decref) Task=`2817e5ab-cfb8-4a89-9770-6d7e70381a02`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:08:58,163::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 11:08:58,164::task::595::TaskManager.Task::(_updateState) Task=`ce4e7afa-2114-400a-9ad9-b80e2f69b660`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:08:58,165::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:08:58,165::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`de264130-0769-4933-86af-49ef85efdc5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:08:58,165::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:08:58,166::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:08:58,166::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`de264130-0769-4933-86af-49ef85efdc5e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:08:58,167::task::827::TaskManager.Task::(resourceAcquired) Task=`ce4e7afa-2114-400a-9ad9-b80e2f69b660`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:08:58,167::task::990::TaskManager.Task::(_decref) Task=`ce4e7afa-2114-400a-9ad9-b80e2f69b660`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:08:58,171::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:58,172::task::1185::TaskManager.Task::(prepare) Task=`ce4e7afa-2114-400a-9ad9-b80e2f69b660`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896260608', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:08:58,172::task::595::TaskManager.Task::(_updateState) Task=`ce4e7afa-2114-400a-9ad9-b80e2f69b660`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:08:58,172::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:08:58,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:08:58,173::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:08:58,173::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:08:58,173::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:08:58,173::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:08:58,174::task::990::TaskManager.Task::(_decref) Task=`ce4e7afa-2114-400a-9ad9-b80e2f69b660`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:08:58,793::task::595::TaskManager.Task::(_updateState) Task=`54b1ae74-8cab-4912-b630-656c78c3843e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:08:58,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:08:58,794::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044899', 'lastCheck': '0.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:08:58,795::task::1185::TaskManager.Task::(prepare) Task=`54b1ae74-8cab-4912-b630-656c78c3843e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044899', 'lastCheck': '0.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:08:58,795::task::595::TaskManager.Task::(_updateState) Task=`54b1ae74-8cab-4912-b630-656c78c3843e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:08:58,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:08:58,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:08:58,796::task::990::TaskManager.Task::(_decref) Task=`54b1ae74-8cab-4912-b630-656c78c3843e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:09:00,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:00,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0988898 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:09:02,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:04,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.76075 s, 582 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:09:06,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:06,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0970647 s, 10.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:09:08,072::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:09:08,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00172067 s, 289 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:09:08,202::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [255ff494]
>Thread-13::DEBUG::2014-08-21 11:09:08,204::task::595::TaskManager.Task::(_updateState) Task=`a6ed7d9c-12ce-456f-a029-3552f31e1465`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:09:08,204::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:09:08,205::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:09:08,206::task::1185::TaskManager.Task::(prepare) Task=`a6ed7d9c-12ce-456f-a029-3552f31e1465`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:09:08,206::task::595::TaskManager.Task::(_updateState) Task=`a6ed7d9c-12ce-456f-a029-3552f31e1465`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:09:08,207::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:09:08,207::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:09:08,208::task::990::TaskManager.Task::(_decref) Task=`a6ed7d9c-12ce-456f-a029-3552f31e1465`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:09:08,214::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [255ff494]
>Thread-34::DEBUG::2014-08-21 11:09:08,215::task::595::TaskManager.Task::(_updateState) Task=`e38c1b7d-c3e0-488c-a708-0b4961971b04`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:09:08,215::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:09:08,217::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`44c2af12-63f3-4b9d-bd9f-1f8e123515b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:09:08,217::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:09:08,218::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:09:08,219::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`44c2af12-63f3-4b9d-bd9f-1f8e123515b1`::Granted request
>Thread-34::DEBUG::2014-08-21 11:09:08,222::task::827::TaskManager.Task::(resourceAcquired) Task=`e38c1b7d-c3e0-488c-a708-0b4961971b04`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:09:08,222::task::990::TaskManager.Task::(_decref) Task=`e38c1b7d-c3e0-488c-a708-0b4961971b04`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:09:08,230::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:09:08,230::task::1185::TaskManager.Task::(prepare) Task=`e38c1b7d-c3e0-488c-a708-0b4961971b04`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896326144', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:09:08,231::task::595::TaskManager.Task::(_updateState) Task=`e38c1b7d-c3e0-488c-a708-0b4961971b04`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:09:08,231::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:09:08,231::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:09:08,232::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:09:08,233::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:09:08,233::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:09:08,233::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:09:08,235::task::990::TaskManager.Task::(_decref) Task=`e38c1b7d-c3e0-488c-a708-0b4961971b04`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:09:08,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:09,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0771905 s, 13.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:09:11,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:11,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584987 s, 17.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:09:13,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:13,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0706701 s, 14.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:09:13,950::task::595::TaskManager.Task::(_updateState) Task=`1d3aea56-71e9-48c2-8cc7-e9d79522c511`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:09:13,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:09:13,963::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00172067', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:09:13,964::task::1185::TaskManager.Task::(prepare) Task=`1d3aea56-71e9-48c2-8cc7-e9d79522c511`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00172067', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:09:13,964::task::595::TaskManager.Task::(_updateState) Task=`1d3aea56-71e9-48c2-8cc7-e9d79522c511`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:09:13,965::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:09:13,965::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:09:13,966::task::990::TaskManager.Task::(_decref) Task=`1d3aea56-71e9-48c2-8cc7-e9d79522c511`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:09:15,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:15,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0628426 s, 16.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:09:26,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:09:34,199::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Dummy-33::DEBUG::2014-08-21 11:09:34,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:09:35,710::task::595::TaskManager.Task::(_updateState) Task=`abae55d7-4988-4136-aa2a-b601e7b6532c`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 11:09:35,793::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00462164 s, 108 kB/s\n'; <rc> = 0
>Thread-26::INFO::2014-08-21 11:09:35,795::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:09:35,821::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:09:35,842::task::1185::TaskManager.Task::(prepare) Task=`abae55d7-4988-4136-aa2a-b601e7b6532c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:09:35,858::task::595::TaskManager.Task::(_updateState) Task=`abae55d7-4988-4136-aa2a-b601e7b6532c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:09:35,868::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:09:35,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:09:35,919::task::990::TaskManager.Task::(_decref) Task=`abae55d7-4988-4136-aa2a-b601e7b6532c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:09:35,948::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-34::DEBUG::2014-08-21 11:09:35,957::task::595::TaskManager.Task::(_updateState) Task=`03d0945d-b274-41d9-8fa7-dcc47c6ed608`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:09:35,961::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:09:35,973::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`63908e85-4ae7-427f-8048-0093ab73cf40`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:09:35,976::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:09:35,988::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:09:35,993::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`63908e85-4ae7-427f-8048-0093ab73cf40`::Granted request
>Thread-34::DEBUG::2014-08-21 11:09:36,023::task::827::TaskManager.Task::(resourceAcquired) Task=`03d0945d-b274-41d9-8fa7-dcc47c6ed608`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:09:36,032::task::990::TaskManager.Task::(_decref) Task=`03d0945d-b274-41d9-8fa7-dcc47c6ed608`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:09:36,105::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:09:36,106::task::1185::TaskManager.Task::(prepare) Task=`03d0945d-b274-41d9-8fa7-dcc47c6ed608`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:09:36,107::task::595::TaskManager.Task::(_updateState) Task=`03d0945d-b274-41d9-8fa7-dcc47c6ed608`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:09:36,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:09:36,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:09:36,109::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:09:36,109::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:09:36,110::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:09:36,110::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:09:36,111::task::990::TaskManager.Task::(_decref) Task=`03d0945d-b274-41d9-8fa7-dcc47c6ed608`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:09:36,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.85284 s, 553 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:09:41,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:09:46,566::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-26::DEBUG::2014-08-21 11:09:46,568::task::595::TaskManager.Task::(_updateState) Task=`5d0d781f-1392-40b0-a30f-06e4b7736d94`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:09:46,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:09:46,570::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:09:46,570::task::1185::TaskManager.Task::(prepare) Task=`5d0d781f-1392-40b0-a30f-06e4b7736d94`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:09:46,571::task::595::TaskManager.Task::(_updateState) Task=`5d0d781f-1392-40b0-a30f-06e4b7736d94`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:09:46,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:09:46,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:09:46,573::task::990::TaskManager.Task::(_decref) Task=`5d0d781f-1392-40b0-a30f-06e4b7736d94`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:09:46,654::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-34::DEBUG::2014-08-21 11:09:46,667::task::595::TaskManager.Task::(_updateState) Task=`b4df25ff-2837-4e79-b5ea-5c321ee53578`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:09:46,676::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:09:46,778::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fdb745da-f94c-403c-b5c8-2728b9b67f24`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:09:46,785::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:09:46,792::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:09:46,800::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fdb745da-f94c-403c-b5c8-2728b9b67f24`::Granted request
>Thread-34::DEBUG::2014-08-21 11:09:46,814::task::827::TaskManager.Task::(resourceAcquired) Task=`b4df25ff-2837-4e79-b5ea-5c321ee53578`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:09:46,822::task::990::TaskManager.Task::(_decref) Task=`b4df25ff-2837-4e79-b5ea-5c321ee53578`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:09:46,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:09:46,983::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00105776 s, 471 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:09:47,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:09:47,018::task::1185::TaskManager.Task::(prepare) Task=`b4df25ff-2837-4e79-b5ea-5c321ee53578`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896719360', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:09:47,022::task::595::TaskManager.Task::(_updateState) Task=`b4df25ff-2837-4e79-b5ea-5c321ee53578`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:09:47,025::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:09:47,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:09:47,033::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:09:47,037::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:09:47,039::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:09:47,041::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:09:47,046::task::990::TaskManager.Task::(_decref) Task=`b4df25ff-2837-4e79-b5ea-5c321ee53578`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:09:47,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.83754 s, 557 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:09:49,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:51,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.17289 s, 471 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:09:52,063::task::595::TaskManager.Task::(_updateState) Task=`2b9d67c8-60cf-42f0-b337-7fa0fc3b266a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:09:52,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:09:52,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105776', 'lastCheck': '5.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:09:52,065::task::1185::TaskManager.Task::(prepare) Task=`2b9d67c8-60cf-42f0-b337-7fa0fc3b266a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105776', 'lastCheck': '5.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:09:52,065::task::595::TaskManager.Task::(_updateState) Task=`2b9d67c8-60cf-42f0-b337-7fa0fc3b266a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:09:52,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:09:52,065::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:09:52,066::task::990::TaskManager.Task::(_decref) Task=`2b9d67c8-60cf-42f0-b337-7fa0fc3b266a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:09:53,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:53,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.144655 s, 7.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:09:55,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:09:57,246::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-26::DEBUG::2014-08-21 11:09:57,269::task::595::TaskManager.Task::(_updateState) Task=`d2b83765-97bb-4a4b-b84b-214bf872e052`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:09:57,276::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:09:57,285::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:09:57,291::task::1185::TaskManager.Task::(prepare) Task=`d2b83765-97bb-4a4b-b84b-214bf872e052`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:09:57,297::task::595::TaskManager.Task::(_updateState) Task=`d2b83765-97bb-4a4b-b84b-214bf872e052`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:09:57,347::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:09:57,361::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:09:57,365::task::990::TaskManager.Task::(_decref) Task=`d2b83765-97bb-4a4b-b84b-214bf872e052`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:09:57,387::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 11:09:57,392::task::595::TaskManager.Task::(_updateState) Task=`56987acd-c2e9-4f1e-bdf1-17e6c3cf8d92`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:09:57,394::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:09:57,398::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`52e17fc9-dfc8-4ef8-80a5-2213c157e172`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:09:57,399::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:09:57,400::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:09:57,401::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`52e17fc9-dfc8-4ef8-80a5-2213c157e172`::Granted request
>Thread-15::DEBUG::2014-08-21 11:09:57,403::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:09:57,412::task::827::TaskManager.Task::(resourceAcquired) Task=`56987acd-c2e9-4f1e-bdf1-17e6c3cf8d92`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:09:57,414::task::990::TaskManager.Task::(_decref) Task=`56987acd-c2e9-4f1e-bdf1-17e6c3cf8d92`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:09:57,468::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000665807 s, 748 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:09:57,514::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:09:57,514::task::1185::TaskManager.Task::(prepare) Task=`56987acd-c2e9-4f1e-bdf1-17e6c3cf8d92`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:09:57,515::task::595::TaskManager.Task::(_updateState) Task=`56987acd-c2e9-4f1e-bdf1-17e6c3cf8d92`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:09:57,515::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:09:57,516::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:09:57,517::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:09:57,518::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:09:57,518::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:09:57,519::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:09:57,525::task::990::TaskManager.Task::(_decref) Task=`56987acd-c2e9-4f1e-bdf1-17e6c3cf8d92`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:09:57,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.54046 s, 665 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:09:59,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:09:59,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869648 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:10:01,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:10:05,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.29858 s, 310 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:10:07,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:10:07,556::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-26::DEBUG::2014-08-21 11:10:07,557::task::595::TaskManager.Task::(_updateState) Task=`320204b0-3f3f-4a3a-91ed-c4991918c1b5`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:10:07,558::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:10:07,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:10:07,559::task::1185::TaskManager.Task::(prepare) Task=`320204b0-3f3f-4a3a-91ed-c4991918c1b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-26::DEBUG::2014-08-21 11:10:07,559::task::595::TaskManager.Task::(_updateState) Task=`320204b0-3f3f-4a3a-91ed-c4991918c1b5`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:10:07,559::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:10:07,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:10:07,560::task::990::TaskManager.Task::(_decref) Task=`320204b0-3f3f-4a3a-91ed-c4991918c1b5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:10:07,564::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-34::DEBUG::2014-08-21 11:10:07,568::task::595::TaskManager.Task::(_updateState) Task=`b9d69555-3585-4451-8826-2570147deed7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:10:07,569::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:10:07,571::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8c64e5b7-eb75-451e-aa66-144e337850a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:10:07,573::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:10:07,575::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:10:07,576::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8c64e5b7-eb75-451e-aa66-144e337850a6`::Granted request
>Thread-15::DEBUG::2014-08-21 11:10:07,580::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:10:07,580::task::827::TaskManager.Task::(resourceAcquired) Task=`b9d69555-3585-4451-8826-2570147deed7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:10:07,581::task::990::TaskManager.Task::(_decref) Task=`b9d69555-3585-4451-8826-2570147deed7`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:10:07,598::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:10:07,599::task::1185::TaskManager.Task::(prepare) Task=`b9d69555-3585-4451-8826-2570147deed7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 35, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535896391680', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:10:07,600::task::595::TaskManager.Task::(_updateState) Task=`b9d69555-3585-4451-8826-2570147deed7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:10:07,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:10:07,601::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:10:07,603::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:10:07,603::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:10:07,604::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:10:07,604::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:10:07,605::task::990::TaskManager.Task::(_decref) Task=`b9d69555-3585-4451-8826-2570147deed7`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:10:07,626::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00379979 s, 131 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:10:07,778::task::595::TaskManager.Task::(_updateState) Task=`24b97ed4-bc78-479a-8814-bef9c3de4f05`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:10:07,779::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:10:07,780::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00379979', 'lastCheck': '0.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:10:07,781::task::1185::TaskManager.Task::(prepare) Task=`24b97ed4-bc78-479a-8814-bef9c3de4f05`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00379979', 'lastCheck': '0.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:10:07,782::task::595::TaskManager.Task::(_updateState) Task=`24b97ed4-bc78-479a-8814-bef9c3de4f05`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:10:07,783::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:10:07,784::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:10:07,785::task::990::TaskManager.Task::(_decref) Task=`24b97ed4-bc78-479a-8814-bef9c3de4f05`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:10:07,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.270878 s, 3.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:10:10,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:10:10,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0681771 s, 15.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:10:12,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:10:13,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.535958 s, 1.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:10:17,846::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6feafe36]
>Dummy-33::DEBUG::2014-08-21 11:10:21,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:10:22,029::task::595::TaskManager.Task::(_updateState) Task=`db37883a-0fab-48f9-b806-08598d206db6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:10:22,030::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:10:22,032::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:10:22,032::task::1185::TaskManager.Task::(prepare) Task=`db37883a-0fab-48f9-b806-08598d206db6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:10:22,032::task::595::TaskManager.Task::(_updateState) Task=`db37883a-0fab-48f9-b806-08598d206db6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:10:22,033::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:10:22,033::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:10:22,212::task::990::TaskManager.Task::(_decref) Task=`db37883a-0fab-48f9-b806-08598d206db6`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:10:25,300::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:10:25,616::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6feafe36]
>Thread-34::DEBUG::2014-08-21 11:10:25,622::task::595::TaskManager.Task::(_updateState) Task=`6ff2b5ef-bcee-41ae-9132-404626588956`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:10:25,624::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0MainThread::INFO::2014-08-21 11:10:51,611::vdsm::119::vds::(run) (PID: 2680) I am the actual vdsm 4.14.7-2.el6ev vm-18-242.eng.lab.tlv.redhat.com (2.6.32-431.el6.x86_64)
>MainThread::DEBUG::2014-08-21 11:10:51,613::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage'
>MainThread::DEBUG::2014-08-21 11:10:51,613::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0
>MainThread::WARNING::2014-08-21 11:10:51,706::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
>MainThread::DEBUG::2014-08-21 11:10:52,879::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
>MainThread::DEBUG::2014-08-21 11:10:52,955::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
>MainThread::DEBUG::2014-08-21 11:10:52,956::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None)
>MainThread::DEBUG::2014-08-21 11:10:53,284::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
>MainThread::DEBUG::2014-08-21 11:10:53,284::hsm::458::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
>MainThread::DEBUG::2014-08-21 11:10:53,290::hsm::490::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
>MainThread::DEBUG::2014-08-21 11:10:53,290::hsm::491::Storage.HSM::(__cleanStorageRepository) Mount list: []
>MainThread::DEBUG::2014-08-21 11:10:53,291::hsm::493::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
>MainThread::DEBUG::2014-08-21 11:10:53,306::hsm::536::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
>storageRefresh::DEBUG::2014-08-21 11:10:53,307::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>MainThread::INFO::2014-08-21 11:10:53,309::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
>storageRefresh::DEBUG::2014-08-21 11:10:53,314::misc::764::SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-08-21 11:10:53,444::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>storageRefresh::DEBUG::2014-08-21 11:10:53,445::misc::764::SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-08-21 11:10:53,577::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>storageRefresh::DEBUG::2014-08-21 11:10:53,581::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>MainThread::DEBUG::2014-08-21 11:10:53,969::task::595::TaskManager.Task::(_updateState) Task=`11d50777-f7e5-48a8-9362-b90ef8d4e900`::moving from state init -> state preparing
>MainThread::INFO::2014-08-21 11:10:53,970::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x1c887a0>>)
>MainThread::INFO::2014-08-21 11:10:53,970::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
>MainThread::DEBUG::2014-08-21 11:10:53,971::task::1185::TaskManager.Task::(prepare) Task=`11d50777-f7e5-48a8-9362-b90ef8d4e900`::finished: None
>MainThread::DEBUG::2014-08-21 11:10:53,971::task::595::TaskManager.Task::(_updateState) Task=`11d50777-f7e5-48a8-9362-b90ef8d4e900`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-08-21 11:10:53,971::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-08-21 11:10:53,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-08-21 11:10:53,972::task::990::TaskManager.Task::(_decref) Task=`11d50777-f7e5-48a8-9362-b90ef8d4e900`::ref 0 aborting False
>MainThread::INFO::2014-08-21 11:10:53,992::momIF::47::MOM::(__init__) Starting up MOM
>MainThread::INFO::2014-08-21 11:10:53,999::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds.
>VM Channels Listener::INFO::2014-08-21 11:10:54,006::vmChannels::170::vds::(run) Starting VM channels listener thread.
>clientIFinit::DEBUG::2014-08-21 11:10:54,033::libvirtconnection::145::root::(get) trying to connect libvirt
>storageRefresh::DEBUG::2014-08-21 11:10:55,769::misc::772::SamplingMethod::(__call__) Returning last result
>storageRefresh::DEBUG::2014-08-21 11:10:55,770::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>storageRefresh::DEBUG::2014-08-21 11:10:55,806::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-08-21 11:10:55,807::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:55,807::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:55,807::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:55,808::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:55,808::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:55,808::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:55,809::misc::772::SamplingMethod::(__call__) Returning last result
>storageRefresh::DEBUG::2014-08-21 11:10:55,809::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:55,812::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
>storageRefresh::DEBUG::2014-08-21 11:10:56,035::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-08-21 11:10:56,036::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:56,037::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:56,037::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>storageRefresh::DEBUG::2014-08-21 11:10:56,265::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-08-21 11:10:56,266::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:56,266::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None)
>storageRefresh::DEBUG::2014-08-21 11:10:56,541::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-08-21 11:10:56,542::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-08-21 11:10:56,543::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>storageRefresh::DEBUG::2014-08-21 11:10:56,755::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-08-21 11:10:56,756::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::WARNING::2014-08-21 11:10:56,756::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists
>storageRefresh::DEBUG::2014-08-21 11:10:56,762::hsm::393::Storage.HSM::(storageRefresh) HSM is ready
>Thread-13::DEBUG::2014-08-21 11:10:57,014::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call getCapabilities with () {} flowID [1887bc0f]
>Thread-13::DEBUG::2014-08-21 11:10:57,017::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:10:57,036::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:10:57,501::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:f5abf64c517'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '2.el6ev', 'buildtime': 1399908350L, 'version': '4.14.7'}, 'qemu-kvm': {'release': '2.415.el6_5.9', 'buildtime': 1398757031L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.7', 'buildtime': 1395830257L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.9', 'buildtime': 1398757031L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(Fake) CPU', 'hooks': {'before_vm_start': {'10_faqemu': {'md5': 'e3cb338be6b9075a04bed0e7400ab7e2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.18.242', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe6e:8dc6/64'], 'gateway': '10.35.19.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '10.35.18.242', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe6e:8dc6/64'], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.19.254', 'ports': ['eth0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': 'A7E73AE3-4AED-44E9-9C32-C01E2C69CD5C', 'lastClientIface': 'rhevm', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:1a:4a:6e:8d:c6', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '00:1a:4a:6e:8d:c6', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe6e:8dc6/64'], 'speed': 0, 'mtu': '1500'}}, 'software_revision': '2', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': 'unfair_spinlock,pge,clflush,sep,syscall,msr,vmx,cmov,nx,constant_tsc,pat,lm,tsc,fpu,fxsr,pae,mmx,cx8,mce,de,mca,pse,pni,ht,apic,sse,lahf_lm,sse2,hypervisor,ssse3,pse36,mtrr,x2apic,model_486,model_pentium,model_pentium2,model_pentium3,model_pentiumpro,model_qemu32,model_coreduo,model_core2duo,model_n270,model_Conroe,model_Penryn,model_Nehalem,model_Opteron_G1', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:f5abf64c517', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '1858', 'cpuSpeed': '2199.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.3.13'}}
>Thread-13::DEBUG::2014-08-21 11:10:57,513::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call getHardwareInfo with () {} flowID [1887bc0f]
>Thread-13::DEBUG::2014-08-21 11:10:57,984::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'RHEV Hypervisor', 'systemSerialNumber': '52BAF97B-FF2F-E311-0000-100000000006', 'systemFamily': 'Red Hat Enterprise Linux', 'systemVersion': '6Server-6.5.0.1.el6', 'systemUUID': 'a7e73ae3-4aed-44e9-9c32-c01e2c69cd5c', 'systemManufacturer': 'Red Hat'}}
>Thread-13::DEBUG::2014-08-21 11:10:58,129::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cd27a56]
>Thread-13::DEBUG::2014-08-21 11:10:58,130::task::595::TaskManager.Task::(_updateState) Task=`702d0a58-e012-4ea0-b9a4-91747a74c7bf`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:10:58,131::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', conList=[{'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'd37be497-c3c0-42ce-8318-0f300985aaf1', 'port': ''}], options=None)
>Thread-13::WARNING::2014-08-21 11:10:58,136::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142 already exists
>Thread-13::DEBUG::2014-08-21 11:10:58,137::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:11:00,392::hsm::2329::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142
>Thread-13::DEBUG::2014-08-21 11:11:00,413::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('664aab68-c780-4f9b-9553-a35e801fdb8b',)
>Thread-13::DEBUG::2014-08-21 11:11:00,414::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {664aab68-c780-4f9b-9553-a35e801fdb8b: storage.nfsSD.findDomain}
>Thread-13::INFO::2014-08-21 11:11:00,414::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'd37be497-c3c0-42ce-8318-0f300985aaf1'}]}
>Thread-13::DEBUG::2014-08-21 11:11:00,424::task::1185::TaskManager.Task::(prepare) Task=`702d0a58-e012-4ea0-b9a4-91747a74c7bf`::finished: {'statuslist': [{'status': 0, 'id': 'd37be497-c3c0-42ce-8318-0f300985aaf1'}]}
>Thread-13::DEBUG::2014-08-21 11:11:00,425::task::595::TaskManager.Task::(_updateState) Task=`702d0a58-e012-4ea0-b9a4-91747a74c7bf`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:00,425::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:00,426::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:00,426::task::990::TaskManager.Task::(_decref) Task=`702d0a58-e012-4ea0-b9a4-91747a74c7bf`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:00,475::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13]
>Thread-13::DEBUG::2014-08-21 11:11:00,476::task::595::TaskManager.Task::(_updateState) Task=`eceb7704-7496-41b9-939c-c2f1ad5c336d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:00,477::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', hostID=1, msdUUID='664aab68-c780-4f9b-9553-a35e801fdb8b', masterVersion=1, domainsMap=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:00,478::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`30b9df1b-eb55-47fd-b49a-e03b78fae5e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1018' at 'connectStoragePool'
>Thread-13::DEBUG::2014-08-21 11:11:00,478::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-13::DEBUG::2014-08-21 11:11:00,479::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-08-21 11:11:00,479::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`30b9df1b-eb55-47fd-b49a-e03b78fae5e4`::Granted request
>Thread-13::DEBUG::2014-08-21 11:11:00,481::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1ada8a5d-6a71-4f59-8d28-44214d90f232`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1066' at '_connectStoragePool'
>Thread-13::DEBUG::2014-08-21 11:11:00,481::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'exclusive'
>Thread-13::DEBUG::2014-08-21 11:11:00,481::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-08-21 11:11:00,482::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1ada8a5d-6a71-4f59-8d28-44214d90f232`::Granted request
>Thread-13::INFO::2014-08-21 11:11:00,483::sp::133::Storage.StoragePool::(setBackend) updating pool 80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 backend from type NoneType instance 0x3805f72210 to type StoragePoolDiskBackend instance 0x7f3d18126f38
>Thread-13::INFO::2014-08-21 11:11:00,483::sp::623::Storage.StoragePool::(connect) Connect host #1 to the storage pool 80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 with master domain: 664aab68-c780-4f9b-9553-a35e801fdb8b (ver = 1)
>Thread-13::DEBUG::2014-08-21 11:11:00,483::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,483::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,484::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,484::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,484::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,485::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,485::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-13::DEBUG::2014-08-21 11:11:00,485::misc::764::SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-08-21 11:11:00,485::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-13::DEBUG::2014-08-21 11:11:00,485::misc::764::SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-08-21 11:11:00,486::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-13::DEBUG::2014-08-21 11:11:00,486::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:11:00,532::misc::772::SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-08-21 11:11:00,533::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:11:00,615::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:11:00,618::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,618::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,618::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,619::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,619::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,619::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:00,619::misc::772::SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-08-21 11:11:00,849::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-13::DEBUG::2014-08-21 11:11:01,128::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-13::DEBUG::2014-08-21 11:11:01,142::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-13::DEBUG::2014-08-21 11:11:01,167::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-13::DEBUG::2014-08-21 11:11:01,168::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS'
>Thread-13::DEBUG::2014-08-21 11:11:01,168::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS'
>Thread-13::DEBUG::2014-08-21 11:11:01,169::sp::1375::Storage.StoragePool::(setMasterDomain) Master domain 664aab68-c780-4f9b-9553-a35e801fdb8b verified, version 1
>Thread-13::DEBUG::2014-08-21 11:11:01,169::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-13::DEBUG::2014-08-21 11:11:01,169::misc::764::SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-08-21 11:11:01,181::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-13::INFO::2014-08-21 11:11:01,182::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:11:01,183::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-13::DEBUG::2014-08-21 11:11:01,189::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `80a3d808-3945-4db3-91ed-9a8fd0e1e9f8` started monitoring domain `664aab68-c780-4f9b-9553-a35e801fdb8b`
>Thread-13::DEBUG::2014-08-21 11:11:01,214::misc::772::SamplingMethod::(__call__) Returning last result
>Thread-13::WARNING::2014-08-21 11:11:01,216::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 already exists
>Thread-13::DEBUG::2014-08-21 11:11:01,252::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-13::DEBUG::2014-08-21 11:11:01,254::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-08-21 11:11:01,255::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:11:01,514::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:11:01,538::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:11:01,541::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00147667 s, 337 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:11:01,551::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-15::DEBUG::2014-08-21 11:11:01,596::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 664aab68-c780-4f9b-9553-a35e801fdb8b changed its status to Valid
>Thread-17::DEBUG::2014-08-21 11:11:01,611::misc::884::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-15::INFO::2014-08-21 11:11:01,612::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 664aab68-c780-4f9b-9553-a35e801fdb8b (id: 1)
>Thread-17::DEBUG::2014-08-21 11:11:01,613::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_onDomainStateChange`
>Thread-15::DEBUG::2014-08-21 11:11:01,614::clusterlock::202::SANLock::(acquireHostId) Host id for domain 664aab68-c780-4f9b-9553-a35e801fdb8b successfully acquired (id: 1)
>Thread-17::DEBUG::2014-08-21 11:11:01,615::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-13::INFO::2014-08-21 11:11:01,620::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b to /rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-19::INFO::2014-08-21 11:11:01,622::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-13::INFO::2014-08-21 11:11:01,622::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b to /rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd
>Thread-17::DEBUG::2014-08-21 11:11:01,623::misc::904::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-13::DEBUG::2014-08-21 11:11:01,626::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0
>Thread-13::DEBUG::2014-08-21 11:11:01,640::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:11:01,689::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0359799 s, 114 kB/s\n'; <rc> = 0
>Thread-13::INFO::2014-08-21 11:11:01,690::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8']
>Thread-13::DEBUG::2014-08-21 11:11:01,691::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:11:01,765::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0158138 s, 259 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:11:01,768::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 80a3d808-3945-4db3-91ed-9a8fd0e1e9f8
>Thread-13::DEBUG::2014-08-21 11:11:01,768::sp::465::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 on master domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-13::DEBUG::2014-08-21 11:11:01,769::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-13::DEBUG::2014-08-21 11:11:01,769::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-13::DEBUG::2014-08-21 11:11:01,769::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-08-21 11:11:01,770::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-13::DEBUG::2014-08-21 11:11:01,770::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-13::DEBUG::2014-08-21 11:11:01,770::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-13::DEBUG::2014-08-21 11:11:01,771::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-08-21 11:11:01,771::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-13::INFO::2014-08-21 11:11:01,771::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-13::DEBUG::2014-08-21 11:11:01,772::task::1185::TaskManager.Task::(prepare) Task=`eceb7704-7496-41b9-939c-c2f1ad5c336d`::finished: True
>Thread-13::DEBUG::2014-08-21 11:11:01,772::task::595::TaskManager.Task::(_updateState) Task=`eceb7704-7496-41b9-939c-c2f1ad5c336d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:01,772::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:01,772::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:01,773::task::990::TaskManager.Task::(_decref) Task=`eceb7704-7496-41b9-939c-c2f1ad5c336d`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:01,827::task::595::TaskManager.Task::(_updateState) Task=`157d8399-45cd-42b7-96c1-069093d2aef6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:01,828::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:11:01,829::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '0.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:11:01,829::task::1185::TaskManager.Task::(prepare) Task=`157d8399-45cd-42b7-96c1-069093d2aef6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '0.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:11:01,829::task::595::TaskManager.Task::(_updateState) Task=`157d8399-45cd-42b7-96c1-069093d2aef6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:01,829::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:01,830::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:01,830::task::990::TaskManager.Task::(_decref) Task=`157d8399-45cd-42b7-96c1-069093d2aef6`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:01,852::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': False},) {} flowID [5cd27a56]
>Thread-13::DEBUG::2014-08-21 11:11:01,996::BindingXMLRPC::1074::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}}
>Thread-13::DEBUG::2014-08-21 11:11:05,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:05,458::task::595::TaskManager.Task::(_updateState) Task=`2cbf9b53-5e97-4a57-81a5-d0133f9b1dfd`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:05,463::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::DEBUG::2014-08-21 11:11:05,477::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-13::INFO::2014-08-21 11:11:05,478::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:11:05,478::task::1185::TaskManager.Task::(prepare) Task=`2cbf9b53-5e97-4a57-81a5-d0133f9b1dfd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:11:05,479::task::595::TaskManager.Task::(_updateState) Task=`2cbf9b53-5e97-4a57-81a5-d0133f9b1dfd`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:05,479::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:05,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:05,480::task::990::TaskManager.Task::(_decref) Task=`2cbf9b53-5e97-4a57-81a5-d0133f9b1dfd`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:05,488::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:05,489::task::595::TaskManager.Task::(_updateState) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:05,490::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-13::ERROR::2014-08-21 11:11:05,490::task::866::TaskManager.Task::(_setError) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 873, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 2126, in getAllTasksStatuses
>    allTasksStatus = sp.getAllTasksStatuses()
>  File "/usr/share/vdsm/storage/securable.py", line 73, in wrapper
>    raise SecureError("Secured object is not in safe state")
>SecureError: Secured object is not in safe state
>Thread-13::DEBUG::2014-08-21 11:11:05,524::task::885::TaskManager.Task::(_run) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::Task._run: fe514fc4-6f4e-4750-9751-ec14046f2a12 () {} failed - stopping task
>Thread-13::DEBUG::2014-08-21 11:11:05,524::task::1211::TaskManager.Task::(stop) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::stopping in state preparing (force False)
>Thread-13::DEBUG::2014-08-21 11:11:05,524::task::990::TaskManager.Task::(_decref) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::ref 1 aborting True
>Thread-13::INFO::2014-08-21 11:11:05,524::task::1168::TaskManager.Task::(prepare) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::aborting: Task is aborted: u'Secured object is not in safe state' - code 100
>Thread-13::DEBUG::2014-08-21 11:11:05,525::task::1173::TaskManager.Task::(prepare) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::Prepare: aborted: Secured object is not in safe state
>Thread-13::DEBUG::2014-08-21 11:11:05,525::task::990::TaskManager.Task::(_decref) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::ref 0 aborting True
>Thread-13::DEBUG::2014-08-21 11:11:05,525::task::925::TaskManager.Task::(_doAbort) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::Task._doAbort: force False
>Thread-13::DEBUG::2014-08-21 11:11:05,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:05,525::task::595::TaskManager.Task::(_updateState) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::moving from state preparing -> state aborting
>Thread-13::DEBUG::2014-08-21 11:11:05,526::task::550::TaskManager.Task::(__state_aborting) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::_aborting: recover policy none
>Thread-13::DEBUG::2014-08-21 11:11:05,526::task::595::TaskManager.Task::(_updateState) Task=`fe514fc4-6f4e-4750-9751-ec14046f2a12`::moving from state aborting -> state failed
>Thread-13::DEBUG::2014-08-21 11:11:05,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:05,526::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::ERROR::2014-08-21 11:11:05,527::dispatcher::68::Storage.Dispatcher.Protect::(run) Secured object is not in safe state
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/dispatcher.py", line 60, in run
>    result = ctask.prepare(self.func, *args, **kwargs)
>  File "/usr/share/vdsm/storage/task.py", line 103, in wrapper
>    return m(self, *a, **kw)
>  File "/usr/share/vdsm/storage/task.py", line 1176, in prepare
>    raise self.error
>SecureError: Secured object is not in safe state
>Thread-13::DEBUG::2014-08-21 11:11:05,579::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:05,580::task::595::TaskManager.Task::(_updateState) Task=`7e0574e5-b8a8-4205-ab09-4792881874f3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:05,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::DEBUG::2014-08-21 11:11:05,593::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-13::INFO::2014-08-21 11:11:05,593::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:11:05,594::task::1185::TaskManager.Task::(prepare) Task=`7e0574e5-b8a8-4205-ab09-4792881874f3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:11:05,594::task::595::TaskManager.Task::(_updateState) Task=`7e0574e5-b8a8-4205-ab09-4792881874f3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:05,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:05,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:05,595::task::990::TaskManager.Task::(_decref) Task=`7e0574e5-b8a8-4205-ab09-4792881874f3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:05,639::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:05,643::task::595::TaskManager.Task::(_updateState) Task=`9a36a73a-c63c-46f3-978d-300b741cac26`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:05,644::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::DEBUG::2014-08-21 11:11:05,653::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>Thread-13::INFO::2014-08-21 11:11:05,654::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:11:05,655::task::1185::TaskManager.Task::(prepare) Task=`9a36a73a-c63c-46f3-978d-300b741cac26`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'Free', 'spmLver': 35}}
>Thread-13::DEBUG::2014-08-21 11:11:05,655::task::595::TaskManager.Task::(_updateState) Task=`9a36a73a-c63c-46f3-978d-300b741cac26`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:05,655::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:05,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:05,656::task::990::TaskManager.Task::(_decref) Task=`9a36a73a-c63c-46f3-978d-300b741cac26`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:05,708::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:05,709::task::595::TaskManager.Task::(_updateState) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:05,710::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', prevID=1, prevLVER='35', maxHostID=250, domVersion='3', options=None)
>Thread-13::DEBUG::2014-08-21 11:11:05,711::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`22e162f2-9b22-4a0e-927b-1a90d1f3d53b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '588' at 'spmStart'
>Thread-13::DEBUG::2014-08-21 11:11:05,712::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'exclusive'
>Thread-13::DEBUG::2014-08-21 11:11:05,713::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-08-21 11:11:05,713::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`22e162f2-9b22-4a0e-927b-1a90d1f3d53b`::Granted request
>Thread-13::DEBUG::2014-08-21 11:11:05,713::task::827::TaskManager.Task::(resourceAcquired) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (exclusive)
>Thread-13::DEBUG::2014-08-21 11:11:05,713::task::990::TaskManager.Task::(_decref) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::ref 1 aborting False
>Thread-13::INFO::2014-08-21 11:11:05,714::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None
>Thread-13::DEBUG::2014-08-21 11:11:05,714::task::1180::TaskManager.Task::(prepare) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::Prepare: 1 jobs exist, move to acquiring
>Thread-13::DEBUG::2014-08-21 11:11:05,714::task::595::TaskManager.Task::(_updateState) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::moving from state preparing -> state acquiring
>Thread-13::DEBUG::2014-08-21 11:11:05,714::task::595::TaskManager.Task::(_updateState) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::moving from state acquiring -> state queued
>Thread-13::DEBUG::2014-08-21 11:11:05,715::taskManager::50::TaskManager::(_queueTask) queuing task: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:05,715::taskManager::56::TaskManager::(_queueTask) task queued: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-1::DEBUG::2014-08-21 11:11:05,716::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
>Thread-13::DEBUG::2014-08-21 11:11:05,716::task::1182::TaskManager.Task::(prepare) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::returning
>Thread-13::DEBUG::2014-08-21 11:11:05,717::task::990::TaskManager.Task::(_decref) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::ref 0 aborting False
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,717::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 264a4ef3-c927-4078-a89e-83ba4d724e50 running: <bound method Task.commit of <storage.task.Task instance at 0x7f3d1806ab00>> with: None
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,719::task::1194::TaskManager.Task::(commit) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::committing task: 264a4ef3-c927-4078-a89e-83ba4d724e50
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,719::task::595::TaskManager.Task::(_updateState) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::moving from state queued -> state running
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,721::task::905::TaskManager.Task::(_runJobs) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f3d18146850>> (args: (1, '35', 250, 3) kwargs: {})
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,722::task::331::TaskManager.Task::(run) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f3d18146850>> (args: (1, '35', 250, 3) kwargs: {}) callback None
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,723::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,723::misc::764::SamplingMethod::(__call__) Got in to sampling method
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,738::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,739::misc::772::SamplingMethod::(__call__) Returning last result
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:11:05,755::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>264a4ef3-c927-4078-a89e-83ba4d724e50::INFO::2014-08-21 11:11:05,757::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 664aab68-c780-4f9b-9553-a35e801fdb8b (id: 1)
>Thread-13::DEBUG::2014-08-21 11:11:06,763::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:06,764::task::595::TaskManager.Task::(_updateState) Task=`8bc9723c-f7b0-4076-85e6-183f6ab11b17`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:06,764::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:06,765::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:06,765::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:06,765::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:06,765::task::1185::TaskManager.Task::(prepare) Task=`8bc9723c-f7b0-4076-85e6-183f6ab11b17`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:06,765::task::595::TaskManager.Task::(_updateState) Task=`8bc9723c-f7b0-4076-85e6-183f6ab11b17`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:06,766::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:06,766::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:06,766::task::990::TaskManager.Task::(_decref) Task=`8bc9723c-f7b0-4076-85e6-183f6ab11b17`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:07,771::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:07,772::task::595::TaskManager.Task::(_updateState) Task=`70d18b48-373c-4c71-916f-c9100a219bd5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:07,772::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:07,772::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:07,772::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:07,773::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:07,773::task::1185::TaskManager.Task::(prepare) Task=`70d18b48-373c-4c71-916f-c9100a219bd5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:07,773::task::595::TaskManager.Task::(_updateState) Task=`70d18b48-373c-4c71-916f-c9100a219bd5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:07,773::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:07,773::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:07,774::task::990::TaskManager.Task::(_decref) Task=`70d18b48-373c-4c71-916f-c9100a219bd5`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:08,166::task::595::TaskManager.Task::(_updateState) Task=`4f5c37fa-a93a-4445-8df8-b7fb68f79491`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:08,167::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:11:08,167::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '6.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:11:08,167::task::1185::TaskManager.Task::(prepare) Task=`4f5c37fa-a93a-4445-8df8-b7fb68f79491`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '6.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:11:08,167::task::595::TaskManager.Task::(_updateState) Task=`4f5c37fa-a93a-4445-8df8-b7fb68f79491`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:08,168::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:08,168::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:08,168::task::990::TaskManager.Task::(_decref) Task=`4f5c37fa-a93a-4445-8df8-b7fb68f79491`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:08,780::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:08,782::task::595::TaskManager.Task::(_updateState) Task=`38dc8181-ffc8-4df2-9bfd-6ad13c205f50`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:08,782::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:08,782::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:08,783::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:08,786::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:08,787::task::1185::TaskManager.Task::(prepare) Task=`38dc8181-ffc8-4df2-9bfd-6ad13c205f50`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:08,993::task::595::TaskManager.Task::(_updateState) Task=`38dc8181-ffc8-4df2-9bfd-6ad13c205f50`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:08,994::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:09,008::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:09,009::task::990::TaskManager.Task::(_decref) Task=`38dc8181-ffc8-4df2-9bfd-6ad13c205f50`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:10,024::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:10,025::task::595::TaskManager.Task::(_updateState) Task=`d0752bfe-8e13-4b60-8268-dc5bc24eabe7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:10,026::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:10,026::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:10,026::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:10,027::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:10,027::task::1185::TaskManager.Task::(prepare) Task=`d0752bfe-8e13-4b60-8268-dc5bc24eabe7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:10,027::task::595::TaskManager.Task::(_updateState) Task=`d0752bfe-8e13-4b60-8268-dc5bc24eabe7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:10,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:10,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:10,028::task::990::TaskManager.Task::(_decref) Task=`d0752bfe-8e13-4b60-8268-dc5bc24eabe7`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:11,540::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:11,542::task::595::TaskManager.Task::(_updateState) Task=`ff0ca3df-2d82-4a58-9bc3-2a964ccabc70`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:11,543::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:11,543::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:11,544::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:11,544::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:11,545::task::1185::TaskManager.Task::(prepare) Task=`ff0ca3df-2d82-4a58-9bc3-2a964ccabc70`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:11,545::task::595::TaskManager.Task::(_updateState) Task=`ff0ca3df-2d82-4a58-9bc3-2a964ccabc70`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:11,546::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:11,546::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:11,546::task::990::TaskManager.Task::(_decref) Task=`ff0ca3df-2d82-4a58-9bc3-2a964ccabc70`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:11:11,646::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:11:11,694::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00422161 s, 118 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:11:15,593::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:15,594::task::595::TaskManager.Task::(_updateState) Task=`ee236061-9d68-432f-942a-bc2567dd5b05`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:15,595::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:15,595::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:15,595::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:15,596::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:15,596::task::1185::TaskManager.Task::(prepare) Task=`ee236061-9d68-432f-942a-bc2567dd5b05`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:15,596::task::595::TaskManager.Task::(_updateState) Task=`ee236061-9d68-432f-942a-bc2567dd5b05`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:15,596::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:15,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:15,597::task::990::TaskManager.Task::(_decref) Task=`ee236061-9d68-432f-942a-bc2567dd5b05`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:16,654::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:16,661::task::595::TaskManager.Task::(_updateState) Task=`ba3b1a78-135e-4b29-85e7-203a5e325508`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:16,661::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:16,662::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:16,662::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:16,662::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:16,663::task::1185::TaskManager.Task::(prepare) Task=`ba3b1a78-135e-4b29-85e7-203a5e325508`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:16,663::task::595::TaskManager.Task::(_updateState) Task=`ba3b1a78-135e-4b29-85e7-203a5e325508`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:16,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:16,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:16,664::task::990::TaskManager.Task::(_decref) Task=`ba3b1a78-135e-4b29-85e7-203a5e325508`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:17,677::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:17,684::task::595::TaskManager.Task::(_updateState) Task=`c3c40000-c962-4319-9ec7-cb6ecf40cf9b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:17,702::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:17,708::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:17,720::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:17,732::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:17,743::task::1185::TaskManager.Task::(prepare) Task=`c3c40000-c962-4319-9ec7-cb6ecf40cf9b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:17,760::task::595::TaskManager.Task::(_updateState) Task=`c3c40000-c962-4319-9ec7-cb6ecf40cf9b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:17,766::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:17,785::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:17,795::task::990::TaskManager.Task::(_decref) Task=`c3c40000-c962-4319-9ec7-cb6ecf40cf9b`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:23,097::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:23,110::task::595::TaskManager.Task::(_updateState) Task=`67ba80a0-eb5b-4448-a761-0e80303993f9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:23,112::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:23,112::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:23,112::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:23,113::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:23,113::task::1185::TaskManager.Task::(prepare) Task=`67ba80a0-eb5b-4448-a761-0e80303993f9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:23,113::task::595::TaskManager.Task::(_updateState) Task=`67ba80a0-eb5b-4448-a761-0e80303993f9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:23,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:23,114::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:23,114::task::990::TaskManager.Task::(_decref) Task=`67ba80a0-eb5b-4448-a761-0e80303993f9`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:24,123::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:24,124::task::595::TaskManager.Task::(_updateState) Task=`ec9e724d-b0fa-4460-92ae-4e96dfff16b3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:24,124::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:24,124::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:24,125::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:24,125::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:24,125::task::1185::TaskManager.Task::(prepare) Task=`ec9e724d-b0fa-4460-92ae-4e96dfff16b3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:24,126::task::595::TaskManager.Task::(_updateState) Task=`ec9e724d-b0fa-4460-92ae-4e96dfff16b3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:24,126::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:24,126::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:24,153::task::990::TaskManager.Task::(_decref) Task=`ec9e724d-b0fa-4460-92ae-4e96dfff16b3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:25,185::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:25,187::task::595::TaskManager.Task::(_updateState) Task=`236e85a6-50cc-4d0c-a841-85a4f90d33ce`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:25,187::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:25,188::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:25,188::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:25,188::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:25,188::task::1185::TaskManager.Task::(prepare) Task=`236e85a6-50cc-4d0c-a841-85a4f90d33ce`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:25,189::task::595::TaskManager.Task::(_updateState) Task=`236e85a6-50cc-4d0c-a841-85a4f90d33ce`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:25,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:25,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:25,190::task::990::TaskManager.Task::(_decref) Task=`236e85a6-50cc-4d0c-a841-85a4f90d33ce`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:26,273::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:26,274::task::595::TaskManager.Task::(_updateState) Task=`dfb6b9ac-cc6e-4ce9-94a3-2cc65f5ab372`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:26,274::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:26,275::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:26,275::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:26,275::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:26,304::task::1185::TaskManager.Task::(prepare) Task=`dfb6b9ac-cc6e-4ce9-94a3-2cc65f5ab372`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:26,305::task::595::TaskManager.Task::(_updateState) Task=`dfb6b9ac-cc6e-4ce9-94a3-2cc65f5ab372`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:26,305::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:26,305::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:26,306::task::990::TaskManager.Task::(_decref) Task=`dfb6b9ac-cc6e-4ce9-94a3-2cc65f5ab372`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:27,859::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:27,887::task::595::TaskManager.Task::(_updateState) Task=`d5a85453-e740-4f1b-8d19-474553b54269`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:27,888::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:28,192::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:28,193::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:28,238::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:28,240::task::1185::TaskManager.Task::(prepare) Task=`d5a85453-e740-4f1b-8d19-474553b54269`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:28,241::task::595::TaskManager.Task::(_updateState) Task=`d5a85453-e740-4f1b-8d19-474553b54269`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:28,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:28,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:28,242::task::990::TaskManager.Task::(_decref) Task=`d5a85453-e740-4f1b-8d19-474553b54269`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:29,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:29,329::task::595::TaskManager.Task::(_updateState) Task=`f47f2c8c-4e5f-4298-bff0-29f07554c269`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:29,330::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:29,330::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:29,330::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:29,331::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:29,331::task::1185::TaskManager.Task::(prepare) Task=`f47f2c8c-4e5f-4298-bff0-29f07554c269`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:29,331::task::595::TaskManager.Task::(_updateState) Task=`f47f2c8c-4e5f-4298-bff0-29f07554c269`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:29,337::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:29,338::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:29,338::task::990::TaskManager.Task::(_decref) Task=`f47f2c8c-4e5f-4298-bff0-29f07554c269`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:29,484::task::595::TaskManager.Task::(_updateState) Task=`2f4bf91f-6814-4fd7-9285-41553ddc9987`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:29,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:11:29,485::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '27.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:11:29,486::task::1185::TaskManager.Task::(prepare) Task=`2f4bf91f-6814-4fd7-9285-41553ddc9987`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '27.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:11:29,486::task::595::TaskManager.Task::(_updateState) Task=`2f4bf91f-6814-4fd7-9285-41553ddc9987`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:29,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:29,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:29,487::task::990::TaskManager.Task::(_decref) Task=`2f4bf91f-6814-4fd7-9285-41553ddc9987`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:30,395::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:30,396::task::595::TaskManager.Task::(_updateState) Task=`95a070f2-1c6e-4963-b418-cf82871a52a9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:30,396::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:30,397::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:30,397::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:30,397::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:30,398::task::1185::TaskManager.Task::(prepare) Task=`95a070f2-1c6e-4963-b418-cf82871a52a9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:30,398::task::595::TaskManager.Task::(_updateState) Task=`95a070f2-1c6e-4963-b418-cf82871a52a9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:30,398::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:30,398::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:30,399::task::990::TaskManager.Task::(_decref) Task=`95a070f2-1c6e-4963-b418-cf82871a52a9`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:31,429::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:31,430::task::595::TaskManager.Task::(_updateState) Task=`44eb121c-d575-40bd-81fe-1bc00a183398`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:31,431::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:31,431::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:31,431::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:31,431::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:31,432::task::1185::TaskManager.Task::(prepare) Task=`44eb121c-d575-40bd-81fe-1bc00a183398`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:31,432::task::595::TaskManager.Task::(_updateState) Task=`44eb121c-d575-40bd-81fe-1bc00a183398`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:31,432::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:31,432::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:31,433::task::990::TaskManager.Task::(_decref) Task=`44eb121c-d575-40bd-81fe-1bc00a183398`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:32,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:32,451::task::595::TaskManager.Task::(_updateState) Task=`3e30bbd7-c419-4fb1-96e4-a06d43b5be7b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:32,452::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:32,452::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:32,452::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:32,453::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:32,453::task::1185::TaskManager.Task::(prepare) Task=`3e30bbd7-c419-4fb1-96e4-a06d43b5be7b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:32,453::task::595::TaskManager.Task::(_updateState) Task=`3e30bbd7-c419-4fb1-96e4-a06d43b5be7b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:32,454::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:32,454::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:32,467::task::990::TaskManager.Task::(_decref) Task=`3e30bbd7-c419-4fb1-96e4-a06d43b5be7b`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:33,508::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:33,514::task::595::TaskManager.Task::(_updateState) Task=`8a5bc76a-36ea-42b3-b956-09142657c1a5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:33,514::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:33,515::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:33,515::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:33,515::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:33,516::task::1185::TaskManager.Task::(prepare) Task=`8a5bc76a-36ea-42b3-b956-09142657c1a5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:33,516::task::595::TaskManager.Task::(_updateState) Task=`8a5bc76a-36ea-42b3-b956-09142657c1a5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:33,516::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:33,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:33,517::task::990::TaskManager.Task::(_decref) Task=`8a5bc76a-36ea-42b3-b956-09142657c1a5`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:34,586::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:34,587::task::595::TaskManager.Task::(_updateState) Task=`c8ef334a-bcab-4b9c-9666-2b00d82f77f9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:34,587::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:34,587::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:34,588::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:34,588::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:34,588::task::1185::TaskManager.Task::(prepare) Task=`c8ef334a-bcab-4b9c-9666-2b00d82f77f9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:34,588::task::595::TaskManager.Task::(_updateState) Task=`c8ef334a-bcab-4b9c-9666-2b00d82f77f9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:34,589::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:34,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:34,589::task::990::TaskManager.Task::(_decref) Task=`c8ef334a-bcab-4b9c-9666-2b00d82f77f9`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:35,597::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:35,598::task::595::TaskManager.Task::(_updateState) Task=`473ece34-d7ac-4a96-a1bc-f96e258dc0b4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:35,598::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:35,598::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:35,599::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:35,599::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:35,599::task::1185::TaskManager.Task::(prepare) Task=`473ece34-d7ac-4a96-a1bc-f96e258dc0b4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:35,599::task::595::TaskManager.Task::(_updateState) Task=`473ece34-d7ac-4a96-a1bc-f96e258dc0b4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:35,599::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:35,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:35,600::task::990::TaskManager.Task::(_decref) Task=`473ece34-d7ac-4a96-a1bc-f96e258dc0b4`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:36,605::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:36,605::task::595::TaskManager.Task::(_updateState) Task=`ced5cc6f-0cd8-4830-a0df-9b0471977fc3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:36,606::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:36,606::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:36,606::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:36,606::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:36,607::task::1185::TaskManager.Task::(prepare) Task=`ced5cc6f-0cd8-4830-a0df-9b0471977fc3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:36,607::task::595::TaskManager.Task::(_updateState) Task=`ced5cc6f-0cd8-4830-a0df-9b0471977fc3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:36,607::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:36,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:36,607::task::990::TaskManager.Task::(_decref) Task=`ced5cc6f-0cd8-4830-a0df-9b0471977fc3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:37,617::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:37,618::task::595::TaskManager.Task::(_updateState) Task=`96e56b59-7519-4573-a27b-3c1186308a78`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:37,618::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:37,619::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:37,619::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:37,619::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:37,620::task::1185::TaskManager.Task::(prepare) Task=`96e56b59-7519-4573-a27b-3c1186308a78`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:37,620::task::595::TaskManager.Task::(_updateState) Task=`96e56b59-7519-4573-a27b-3c1186308a78`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:37,620::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:37,620::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:37,633::task::990::TaskManager.Task::(_decref) Task=`96e56b59-7519-4573-a27b-3c1186308a78`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:39,844::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:39,845::task::595::TaskManager.Task::(_updateState) Task=`a9061476-e2df-496b-ab66-2b18900c2052`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:39,845::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:39,845::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:39,846::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:39,846::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:39,846::task::1185::TaskManager.Task::(prepare) Task=`a9061476-e2df-496b-ab66-2b18900c2052`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:39,846::task::595::TaskManager.Task::(_updateState) Task=`a9061476-e2df-496b-ab66-2b18900c2052`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:39,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:39,847::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:39,848::task::990::TaskManager.Task::(_decref) Task=`a9061476-e2df-496b-ab66-2b18900c2052`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:40,858::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:40,860::task::595::TaskManager.Task::(_updateState) Task=`6ff56297-d076-4dc6-93dc-2b04f833adf0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:40,861::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:40,861::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:40,861::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:40,862::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:40,862::task::1185::TaskManager.Task::(prepare) Task=`6ff56297-d076-4dc6-93dc-2b04f833adf0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:40,862::task::595::TaskManager.Task::(_updateState) Task=`6ff56297-d076-4dc6-93dc-2b04f833adf0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:40,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:40,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:40,863::task::990::TaskManager.Task::(_decref) Task=`6ff56297-d076-4dc6-93dc-2b04f833adf0`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:41,870::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:41,870::task::595::TaskManager.Task::(_updateState) Task=`0023c9e3-9d84-4936-98c3-b761f7750b3c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:41,871::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:41,871::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:41,871::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:41,872::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:41,873::task::1185::TaskManager.Task::(prepare) Task=`0023c9e3-9d84-4936-98c3-b761f7750b3c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:41,873::task::595::TaskManager.Task::(_updateState) Task=`0023c9e3-9d84-4936-98c3-b761f7750b3c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:41,873::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:41,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:41,874::task::990::TaskManager.Task::(_decref) Task=`0023c9e3-9d84-4936-98c3-b761f7750b3c`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:42,879::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:42,880::task::595::TaskManager.Task::(_updateState) Task=`263ed984-4a79-4242-99cb-25548f411dd8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:42,880::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:42,881::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:42,881::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:42,881::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:42,882::task::1185::TaskManager.Task::(prepare) Task=`263ed984-4a79-4242-99cb-25548f411dd8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:42,882::task::595::TaskManager.Task::(_updateState) Task=`263ed984-4a79-4242-99cb-25548f411dd8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:42,882::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:42,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:42,883::task::990::TaskManager.Task::(_decref) Task=`263ed984-4a79-4242-99cb-25548f411dd8`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:43,933::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:43,934::task::595::TaskManager.Task::(_updateState) Task=`07b8fd2f-c3bd-471a-8abe-755a5bffdb29`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:43,935::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:43,935::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:43,935::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:43,936::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:43,936::task::1185::TaskManager.Task::(prepare) Task=`07b8fd2f-c3bd-471a-8abe-755a5bffdb29`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:43,936::task::595::TaskManager.Task::(_updateState) Task=`07b8fd2f-c3bd-471a-8abe-755a5bffdb29`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:43,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:43,937::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:43,937::task::990::TaskManager.Task::(_decref) Task=`07b8fd2f-c3bd-471a-8abe-755a5bffdb29`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:11:46,587::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:11:46,589::task::595::TaskManager.Task::(_updateState) Task=`49586a9b-2ae1-4428-8f48-7b1d390d43e4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:11:46,589::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:11:46,590::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:11:46,590::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:11:46,590::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:46,591::task::1185::TaskManager.Task::(prepare) Task=`49586a9b-2ae1-4428-8f48-7b1d390d43e4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:11:46,591::task::595::TaskManager.Task::(_updateState) Task=`49586a9b-2ae1-4428-8f48-7b1d390d43e4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:11:46,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:11:46,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:11:46,592::task::990::TaskManager.Task::(_decref) Task=`49586a9b-2ae1-4428-8f48-7b1d390d43e4`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:46,645::task::595::TaskManager.Task::(_updateState) Task=`0cb9d78e-84a5-4423-835c-f4f04e0cf40d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:46,646::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:11:46,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '45.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:11:46,647::task::1185::TaskManager.Task::(prepare) Task=`0cb9d78e-84a5-4423-835c-f4f04e0cf40d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '45.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:11:46,647::task::595::TaskManager.Task::(_updateState) Task=`0cb9d78e-84a5-4423-835c-f4f04e0cf40d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:46,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:46,653::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:46,653::task::990::TaskManager.Task::(_decref) Task=`0cb9d78e-84a5-4423-835c-f4f04e0cf40d`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:47,732::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:47,733::task::595::TaskManager.Task::(_updateState) Task=`de1b1330-b330-45bf-ac2b-e48cf4828e1e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:47,734::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:47,734::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:47,735::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:47,735::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:47,736::task::1185::TaskManager.Task::(prepare) Task=`de1b1330-b330-45bf-ac2b-e48cf4828e1e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:47,736::task::595::TaskManager.Task::(_updateState) Task=`de1b1330-b330-45bf-ac2b-e48cf4828e1e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:47,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:47,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:47,737::task::990::TaskManager.Task::(_decref) Task=`de1b1330-b330-45bf-ac2b-e48cf4828e1e`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:48,747::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:48,749::task::595::TaskManager.Task::(_updateState) Task=`8e77f04e-3813-4c32-b460-7ed573b4e667`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:48,750::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:48,750::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:48,750::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:48,751::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:48,751::task::1185::TaskManager.Task::(prepare) Task=`8e77f04e-3813-4c32-b460-7ed573b4e667`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:48,751::task::595::TaskManager.Task::(_updateState) Task=`8e77f04e-3813-4c32-b460-7ed573b4e667`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:48,752::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:48,752::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:48,752::task::990::TaskManager.Task::(_decref) Task=`8e77f04e-3813-4c32-b460-7ed573b4e667`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:51,299::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:51,405::task::595::TaskManager.Task::(_updateState) Task=`6ee821de-b51b-45d0-a0ee-6287b9898a4d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:51,493::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:51,502::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:51,537::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:51,538::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:51,548::task::1185::TaskManager.Task::(prepare) Task=`6ee821de-b51b-45d0-a0ee-6287b9898a4d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:51,606::task::595::TaskManager.Task::(_updateState) Task=`6ee821de-b51b-45d0-a0ee-6287b9898a4d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:51,607::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:51,613::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:51,627::task::990::TaskManager.Task::(_decref) Task=`6ee821de-b51b-45d0-a0ee-6287b9898a4d`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:52,730::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:52,736::task::595::TaskManager.Task::(_updateState) Task=`e5022fe1-3392-4b19-8664-ff92c4a9aff8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:52,740::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:52,742::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:52,744::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:52,746::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:52,747::task::1185::TaskManager.Task::(prepare) Task=`e5022fe1-3392-4b19-8664-ff92c4a9aff8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:52,749::task::595::TaskManager.Task::(_updateState) Task=`e5022fe1-3392-4b19-8664-ff92c4a9aff8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:52,751::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:52,754::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:52,756::task::990::TaskManager.Task::(_decref) Task=`e5022fe1-3392-4b19-8664-ff92c4a9aff8`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:53,782::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:53,783::task::595::TaskManager.Task::(_updateState) Task=`19a68a8c-1801-4ad3-84a4-ad45a67e1998`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:53,784::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:53,784::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:53,784::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:53,785::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:53,785::task::1185::TaskManager.Task::(prepare) Task=`19a68a8c-1801-4ad3-84a4-ad45a67e1998`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:53,785::task::595::TaskManager.Task::(_updateState) Task=`19a68a8c-1801-4ad3-84a4-ad45a67e1998`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:53,786::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:53,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:53,786::task::990::TaskManager.Task::(_decref) Task=`19a68a8c-1801-4ad3-84a4-ad45a67e1998`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:54,808::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:54,811::task::595::TaskManager.Task::(_updateState) Task=`6bdc2e0e-90a2-4d00-868e-00cc529564a4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:54,812::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:54,813::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:54,814::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:54,814::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:54,816::task::1185::TaskManager.Task::(prepare) Task=`6bdc2e0e-90a2-4d00-868e-00cc529564a4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:54,821::task::595::TaskManager.Task::(_updateState) Task=`6bdc2e0e-90a2-4d00-868e-00cc529564a4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:54,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:54,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:54,826::task::990::TaskManager.Task::(_decref) Task=`6bdc2e0e-90a2-4d00-868e-00cc529564a4`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:55,868::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:55,872::task::595::TaskManager.Task::(_updateState) Task=`c18d9804-fd6b-4e65-80b6-9f12d5b8ec07`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:55,875::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:55,876::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:55,883::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:55,884::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:55,885::task::1185::TaskManager.Task::(prepare) Task=`c18d9804-fd6b-4e65-80b6-9f12d5b8ec07`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:55,887::task::595::TaskManager.Task::(_updateState) Task=`c18d9804-fd6b-4e65-80b6-9f12d5b8ec07`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:55,890::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:55,891::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:55,895::task::990::TaskManager.Task::(_decref) Task=`c18d9804-fd6b-4e65-80b6-9f12d5b8ec07`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:57,578::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:57,897::task::595::TaskManager.Task::(_updateState) Task=`ce136217-3a80-417f-a464-bd1e2b44543e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:57,909::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:57,912::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:57,918::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:57,922::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:57,926::task::1185::TaskManager.Task::(prepare) Task=`ce136217-3a80-417f-a464-bd1e2b44543e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:57,927::task::595::TaskManager.Task::(_updateState) Task=`ce136217-3a80-417f-a464-bd1e2b44543e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:57,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:57,933::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:57,935::task::990::TaskManager.Task::(_decref) Task=`ce136217-3a80-417f-a464-bd1e2b44543e`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:58,943::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:11:58,945::task::595::TaskManager.Task::(_updateState) Task=`4624756e-29e7-4bd9-97d0-9f1aebf16040`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:11:58,945::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:11:58,946::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:11:58,946::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:11:58,946::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:58,947::task::1185::TaskManager.Task::(prepare) Task=`4624756e-29e7-4bd9-97d0-9f1aebf16040`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:11:58,947::task::595::TaskManager.Task::(_updateState) Task=`4624756e-29e7-4bd9-97d0-9f1aebf16040`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:11:58,947::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:11:58,948::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:11:58,948::task::990::TaskManager.Task::(_decref) Task=`4624756e-29e7-4bd9-97d0-9f1aebf16040`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:11:59,998::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:00,268::task::595::TaskManager.Task::(_updateState) Task=`6e3645ae-ffea-41a7-bfed-a1167d647f2d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:00,269::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:00,270::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:00,270::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:00,270::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:00,271::task::1185::TaskManager.Task::(prepare) Task=`6e3645ae-ffea-41a7-bfed-a1167d647f2d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:00,271::task::595::TaskManager.Task::(_updateState) Task=`6e3645ae-ffea-41a7-bfed-a1167d647f2d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:00,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:00,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:00,272::task::990::TaskManager.Task::(_decref) Task=`6e3645ae-ffea-41a7-bfed-a1167d647f2d`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:01,303::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:01,304::task::595::TaskManager.Task::(_updateState) Task=`a37ac109-a5aa-43ef-a94d-d567cda86d0a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:01,304::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:01,304::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:01,305::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:01,305::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:01,305::task::1185::TaskManager.Task::(prepare) Task=`a37ac109-a5aa-43ef-a94d-d567cda86d0a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:01,305::task::595::TaskManager.Task::(_updateState) Task=`a37ac109-a5aa-43ef-a94d-d567cda86d0a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:01,305::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:01,306::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:01,306::task::990::TaskManager.Task::(_decref) Task=`a37ac109-a5aa-43ef-a94d-d567cda86d0a`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:02,319::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:02,320::task::595::TaskManager.Task::(_updateState) Task=`0e72c291-e3f0-4a45-a244-106c6a084719`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:02,321::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:02,321::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:02,321::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:02,322::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:02,322::task::1185::TaskManager.Task::(prepare) Task=`0e72c291-e3f0-4a45-a244-106c6a084719`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:02,322::task::595::TaskManager.Task::(_updateState) Task=`0e72c291-e3f0-4a45-a244-106c6a084719`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:02,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:02,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:02,323::task::990::TaskManager.Task::(_decref) Task=`0e72c291-e3f0-4a45-a244-106c6a084719`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:03,335::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:03,338::task::595::TaskManager.Task::(_updateState) Task=`0b5347bf-3b50-4a5c-8a2e-6de6908238fe`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:03,338::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:03,339::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:03,339::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:03,339::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:03,340::task::1185::TaskManager.Task::(prepare) Task=`0b5347bf-3b50-4a5c-8a2e-6de6908238fe`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:03,340::task::595::TaskManager.Task::(_updateState) Task=`0b5347bf-3b50-4a5c-8a2e-6de6908238fe`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:03,340::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:03,341::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:03,341::task::990::TaskManager.Task::(_decref) Task=`0b5347bf-3b50-4a5c-8a2e-6de6908238fe`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:03,899::task::595::TaskManager.Task::(_updateState) Task=`5309b40c-0817-434a-8c4c-be1ce9c89826`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:03,900::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:12:03,900::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '62.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:12:03,901::task::1185::TaskManager.Task::(prepare) Task=`5309b40c-0817-434a-8c4c-be1ce9c89826`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '62.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:12:03,901::task::595::TaskManager.Task::(_updateState) Task=`5309b40c-0817-434a-8c4c-be1ce9c89826`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:03,901::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:03,901::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:03,902::task::990::TaskManager.Task::(_decref) Task=`5309b40c-0817-434a-8c4c-be1ce9c89826`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:04,347::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:04,349::task::595::TaskManager.Task::(_updateState) Task=`95ee8adf-62c4-4367-86fe-159fa4e9e8de`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:04,350::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:04,350::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:04,351::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:04,351::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:04,352::task::1185::TaskManager.Task::(prepare) Task=`95ee8adf-62c4-4367-86fe-159fa4e9e8de`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:04,352::task::595::TaskManager.Task::(_updateState) Task=`95ee8adf-62c4-4367-86fe-159fa4e9e8de`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:04,352::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:04,353::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:04,353::task::990::TaskManager.Task::(_decref) Task=`95ee8adf-62c4-4367-86fe-159fa4e9e8de`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:05,359::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:05,360::task::595::TaskManager.Task::(_updateState) Task=`1125e23d-66bf-4e76-a6d1-68b274f6acf1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:05,360::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:05,361::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:05,361::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:05,361::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:05,362::task::1185::TaskManager.Task::(prepare) Task=`1125e23d-66bf-4e76-a6d1-68b274f6acf1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:05,362::task::595::TaskManager.Task::(_updateState) Task=`1125e23d-66bf-4e76-a6d1-68b274f6acf1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:05,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:05,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:05,362::task::990::TaskManager.Task::(_decref) Task=`1125e23d-66bf-4e76-a6d1-68b274f6acf1`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:06,369::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:06,370::task::595::TaskManager.Task::(_updateState) Task=`2f5dac03-d149-44c0-aa17-9bf4fc7c537b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:06,371::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:06,371::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:06,372::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:06,372::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:06,372::task::1185::TaskManager.Task::(prepare) Task=`2f5dac03-d149-44c0-aa17-9bf4fc7c537b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:06,373::task::595::TaskManager.Task::(_updateState) Task=`2f5dac03-d149-44c0-aa17-9bf4fc7c537b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:06,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:06,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:06,373::task::990::TaskManager.Task::(_decref) Task=`2f5dac03-d149-44c0-aa17-9bf4fc7c537b`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:07,404::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:07,405::task::595::TaskManager.Task::(_updateState) Task=`1dd0751e-f28e-498c-a3d3-1e0503880537`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:07,406::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:07,406::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:07,407::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:07,407::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:07,407::task::1185::TaskManager.Task::(prepare) Task=`1dd0751e-f28e-498c-a3d3-1e0503880537`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:07,408::task::595::TaskManager.Task::(_updateState) Task=`1dd0751e-f28e-498c-a3d3-1e0503880537`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:07,408::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:07,408::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:07,409::task::990::TaskManager.Task::(_decref) Task=`1dd0751e-f28e-498c-a3d3-1e0503880537`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:08,416::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:08,417::task::595::TaskManager.Task::(_updateState) Task=`2563ee2b-9c4e-4666-ba25-4890e3cb35e6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:08,418::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:08,418::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:08,418::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:08,419::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:08,419::task::1185::TaskManager.Task::(prepare) Task=`2563ee2b-9c4e-4666-ba25-4890e3cb35e6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:08,420::task::595::TaskManager.Task::(_updateState) Task=`2563ee2b-9c4e-4666-ba25-4890e3cb35e6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:08,420::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:08,420::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:08,421::task::990::TaskManager.Task::(_decref) Task=`2563ee2b-9c4e-4666-ba25-4890e3cb35e6`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:09,428::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:09,429::task::595::TaskManager.Task::(_updateState) Task=`dc0f83c2-e079-4196-8529-5a7f8d2d43d4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:09,430::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:09,430::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:09,430::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:09,431::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:09,431::task::1185::TaskManager.Task::(prepare) Task=`dc0f83c2-e079-4196-8529-5a7f8d2d43d4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:09,431::task::595::TaskManager.Task::(_updateState) Task=`dc0f83c2-e079-4196-8529-5a7f8d2d43d4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:09,432::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:09,432::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:09,432::task::990::TaskManager.Task::(_decref) Task=`dc0f83c2-e079-4196-8529-5a7f8d2d43d4`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:10,439::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:10,440::task::595::TaskManager.Task::(_updateState) Task=`d29a0a35-e358-4ddd-8991-4027351b202f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:10,441::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:10,441::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:10,441::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:10,442::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:10,442::task::1185::TaskManager.Task::(prepare) Task=`d29a0a35-e358-4ddd-8991-4027351b202f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:10,442::task::595::TaskManager.Task::(_updateState) Task=`d29a0a35-e358-4ddd-8991-4027351b202f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:10,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:10,443::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:10,443::task::990::TaskManager.Task::(_decref) Task=`d29a0a35-e358-4ddd-8991-4027351b202f`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:11,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:11,451::task::595::TaskManager.Task::(_updateState) Task=`9077c8ab-2d63-4cb1-b908-42637e6800f7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:11,451::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:11,452::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:11,452::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:11,452::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:11,452::task::1185::TaskManager.Task::(prepare) Task=`9077c8ab-2d63-4cb1-b908-42637e6800f7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:11,453::task::595::TaskManager.Task::(_updateState) Task=`9077c8ab-2d63-4cb1-b908-42637e6800f7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:11,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:11,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:11,453::task::990::TaskManager.Task::(_decref) Task=`9077c8ab-2d63-4cb1-b908-42637e6800f7`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:12,463::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:12,464::task::595::TaskManager.Task::(_updateState) Task=`380c77cf-3ca5-43b7-8347-b1eb13bf1775`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:12,465::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:12,465::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:12,465::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:12,465::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:12,466::task::1185::TaskManager.Task::(prepare) Task=`380c77cf-3ca5-43b7-8347-b1eb13bf1775`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:12,466::task::595::TaskManager.Task::(_updateState) Task=`380c77cf-3ca5-43b7-8347-b1eb13bf1775`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:12,466::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:12,466::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:12,466::task::990::TaskManager.Task::(_decref) Task=`380c77cf-3ca5-43b7-8347-b1eb13bf1775`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:13,481::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:13,485::task::595::TaskManager.Task::(_updateState) Task=`931a6e2c-efc7-4f87-b6d2-697376e0bd7b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:13,486::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:13,486::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:13,486::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:13,487::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:13,487::task::1185::TaskManager.Task::(prepare) Task=`931a6e2c-efc7-4f87-b6d2-697376e0bd7b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:13,487::task::595::TaskManager.Task::(_updateState) Task=`931a6e2c-efc7-4f87-b6d2-697376e0bd7b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:13,488::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:13,488::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:13,489::task::990::TaskManager.Task::(_decref) Task=`931a6e2c-efc7-4f87-b6d2-697376e0bd7b`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:14,529::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:14,530::task::595::TaskManager.Task::(_updateState) Task=`0d78edec-dbb9-45fa-9227-0872f73e6ed3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:14,530::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:14,531::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:14,531::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:14,531::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:14,532::task::1185::TaskManager.Task::(prepare) Task=`0d78edec-dbb9-45fa-9227-0872f73e6ed3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:14,532::task::595::TaskManager.Task::(_updateState) Task=`0d78edec-dbb9-45fa-9227-0872f73e6ed3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:14,532::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:14,533::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:14,533::task::990::TaskManager.Task::(_decref) Task=`0d78edec-dbb9-45fa-9227-0872f73e6ed3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:15,539::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:15,540::task::595::TaskManager.Task::(_updateState) Task=`6fb6eee6-a5c6-411f-bf97-05c9f502c9f5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:15,541::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:15,541::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:15,541::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:15,541::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:15,541::task::1185::TaskManager.Task::(prepare) Task=`6fb6eee6-a5c6-411f-bf97-05c9f502c9f5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:15,542::task::595::TaskManager.Task::(_updateState) Task=`6fb6eee6-a5c6-411f-bf97-05c9f502c9f5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:15,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:15,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:15,542::task::990::TaskManager.Task::(_decref) Task=`6fb6eee6-a5c6-411f-bf97-05c9f502c9f5`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:16,547::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:16,548::task::595::TaskManager.Task::(_updateState) Task=`f8429d7e-3c95-4cf1-9771-3f5da23879d9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:16,548::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:16,549::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:16,549::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:16,549::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:16,550::task::1185::TaskManager.Task::(prepare) Task=`f8429d7e-3c95-4cf1-9771-3f5da23879d9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:16,550::task::595::TaskManager.Task::(_updateState) Task=`f8429d7e-3c95-4cf1-9771-3f5da23879d9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:16,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:16,550::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:16,551::task::990::TaskManager.Task::(_decref) Task=`f8429d7e-3c95-4cf1-9771-3f5da23879d9`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:17,556::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:17,557::task::595::TaskManager.Task::(_updateState) Task=`0c8c575c-7e08-434f-810d-703d45e07d7d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:17,557::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:17,557::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:17,558::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:17,558::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:17,558::task::1185::TaskManager.Task::(prepare) Task=`0c8c575c-7e08-434f-810d-703d45e07d7d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:17,558::task::595::TaskManager.Task::(_updateState) Task=`0c8c575c-7e08-434f-810d-703d45e07d7d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:17,559::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:17,559::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:17,559::task::990::TaskManager.Task::(_decref) Task=`0c8c575c-7e08-434f-810d-703d45e07d7d`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:18,566::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:18,568::task::595::TaskManager.Task::(_updateState) Task=`4d385620-4444-4f66-b284-1ad9051b29d8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:18,568::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:18,569::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:18,569::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:18,569::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:18,570::task::1185::TaskManager.Task::(prepare) Task=`4d385620-4444-4f66-b284-1ad9051b29d8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:18,570::task::595::TaskManager.Task::(_updateState) Task=`4d385620-4444-4f66-b284-1ad9051b29d8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:18,570::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:18,571::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:18,571::task::990::TaskManager.Task::(_decref) Task=`4d385620-4444-4f66-b284-1ad9051b29d8`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:19,076::task::595::TaskManager.Task::(_updateState) Task=`24c70ddb-a541-42f5-86d2-61d2afc69a39`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:19,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:12:19,078::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '77.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:12:19,078::task::1185::TaskManager.Task::(prepare) Task=`24c70ddb-a541-42f5-86d2-61d2afc69a39`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '77.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:12:19,079::task::595::TaskManager.Task::(_updateState) Task=`24c70ddb-a541-42f5-86d2-61d2afc69a39`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:19,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:19,079::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:19,081::task::990::TaskManager.Task::(_decref) Task=`24c70ddb-a541-42f5-86d2-61d2afc69a39`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:19,577::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:19,582::task::595::TaskManager.Task::(_updateState) Task=`caba6da5-e2d4-4727-a1af-6dc61d578d7f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:19,583::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:19,584::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:19,584::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:19,584::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:19,585::task::1185::TaskManager.Task::(prepare) Task=`caba6da5-e2d4-4727-a1af-6dc61d578d7f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:19,585::task::595::TaskManager.Task::(_updateState) Task=`caba6da5-e2d4-4727-a1af-6dc61d578d7f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:19,586::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:19,586::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:19,587::task::990::TaskManager.Task::(_decref) Task=`caba6da5-e2d4-4727-a1af-6dc61d578d7f`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:20,625::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:20,626::task::595::TaskManager.Task::(_updateState) Task=`d5195ae8-276f-4044-9a07-8a9348b3f57b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:20,627::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:20,627::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:20,627::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:20,627::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:20,629::task::1185::TaskManager.Task::(prepare) Task=`d5195ae8-276f-4044-9a07-8a9348b3f57b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:20,629::task::595::TaskManager.Task::(_updateState) Task=`d5195ae8-276f-4044-9a07-8a9348b3f57b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:20,629::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:20,630::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:20,630::task::990::TaskManager.Task::(_decref) Task=`d5195ae8-276f-4044-9a07-8a9348b3f57b`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:21,648::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:21,649::task::595::TaskManager.Task::(_updateState) Task=`8c76ee1d-2cba-4377-95c0-14b35bf4fddf`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:21,650::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:21,650::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:21,650::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:21,650::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:21,650::task::1185::TaskManager.Task::(prepare) Task=`8c76ee1d-2cba-4377-95c0-14b35bf4fddf`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:21,651::task::595::TaskManager.Task::(_updateState) Task=`8c76ee1d-2cba-4377-95c0-14b35bf4fddf`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:21,651::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:21,651::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:21,651::task::990::TaskManager.Task::(_decref) Task=`8c76ee1d-2cba-4377-95c0-14b35bf4fddf`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:22,657::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:22,658::task::595::TaskManager.Task::(_updateState) Task=`858b0546-2e57-4af7-93a6-4edb0f1a9c91`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:22,658::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:22,658::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:22,658::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:22,658::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:22,659::task::1185::TaskManager.Task::(prepare) Task=`858b0546-2e57-4af7-93a6-4edb0f1a9c91`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:22,659::task::595::TaskManager.Task::(_updateState) Task=`858b0546-2e57-4af7-93a6-4edb0f1a9c91`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:22,659::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:22,659::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:22,660::task::990::TaskManager.Task::(_decref) Task=`858b0546-2e57-4af7-93a6-4edb0f1a9c91`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:23,674::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:23,676::task::595::TaskManager.Task::(_updateState) Task=`eeebbd31-b276-4d00-ac55-08aa112f999a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:23,677::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:23,677::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:23,677::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:23,677::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:23,678::task::1185::TaskManager.Task::(prepare) Task=`eeebbd31-b276-4d00-ac55-08aa112f999a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:23,678::task::595::TaskManager.Task::(_updateState) Task=`eeebbd31-b276-4d00-ac55-08aa112f999a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:23,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:23,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:23,679::task::990::TaskManager.Task::(_decref) Task=`eeebbd31-b276-4d00-ac55-08aa112f999a`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:24,695::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:24,696::task::595::TaskManager.Task::(_updateState) Task=`bee114f6-6fb2-44e1-a876-fd50a4a449fb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:24,696::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:24,697::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:24,697::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:24,697::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:24,698::task::1185::TaskManager.Task::(prepare) Task=`bee114f6-6fb2-44e1-a876-fd50a4a449fb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:24,698::task::595::TaskManager.Task::(_updateState) Task=`bee114f6-6fb2-44e1-a876-fd50a4a449fb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:24,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:24,699::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:24,699::task::990::TaskManager.Task::(_decref) Task=`bee114f6-6fb2-44e1-a876-fd50a4a449fb`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:25,718::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:25,719::task::595::TaskManager.Task::(_updateState) Task=`6e13e075-4d00-45d6-a45a-7a40c1ce74f2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:25,720::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:25,720::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:25,721::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:25,721::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:25,721::task::1185::TaskManager.Task::(prepare) Task=`6e13e075-4d00-45d6-a45a-7a40c1ce74f2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:25,722::task::595::TaskManager.Task::(_updateState) Task=`6e13e075-4d00-45d6-a45a-7a40c1ce74f2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:25,722::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:25,722::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:25,722::task::990::TaskManager.Task::(_decref) Task=`6e13e075-4d00-45d6-a45a-7a40c1ce74f2`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:26,733::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:26,734::task::595::TaskManager.Task::(_updateState) Task=`dbf8f4e3-7891-42b6-9efe-ff52625655a8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:26,735::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:26,735::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:26,735::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:26,736::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:26,736::task::1185::TaskManager.Task::(prepare) Task=`dbf8f4e3-7891-42b6-9efe-ff52625655a8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:26,736::task::595::TaskManager.Task::(_updateState) Task=`dbf8f4e3-7891-42b6-9efe-ff52625655a8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:26,737::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:26,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:26,737::task::990::TaskManager.Task::(_decref) Task=`dbf8f4e3-7891-42b6-9efe-ff52625655a8`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:28,201::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:28,203::task::595::TaskManager.Task::(_updateState) Task=`407b2103-fd87-4c54-8450-873055e55d01`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:28,204::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:28,204::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:28,204::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:28,204::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:28,205::task::1185::TaskManager.Task::(prepare) Task=`407b2103-fd87-4c54-8450-873055e55d01`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:28,205::task::595::TaskManager.Task::(_updateState) Task=`407b2103-fd87-4c54-8450-873055e55d01`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:28,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:28,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:28,206::task::990::TaskManager.Task::(_decref) Task=`407b2103-fd87-4c54-8450-873055e55d01`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:29,256::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:29,260::task::595::TaskManager.Task::(_updateState) Task=`643f758d-9e57-4de4-ba44-27b1b2704593`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:29,260::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:29,260::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:29,261::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:29,261::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:29,261::task::1185::TaskManager.Task::(prepare) Task=`643f758d-9e57-4de4-ba44-27b1b2704593`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:29,262::task::595::TaskManager.Task::(_updateState) Task=`643f758d-9e57-4de4-ba44-27b1b2704593`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:29,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:29,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:29,262::task::990::TaskManager.Task::(_decref) Task=`643f758d-9e57-4de4-ba44-27b1b2704593`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:30,300::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:30,301::task::595::TaskManager.Task::(_updateState) Task=`05c083a1-59c8-4b60-8c1f-9381153139a4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:30,301::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:30,302::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:30,302::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:30,302::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:30,302::task::1185::TaskManager.Task::(prepare) Task=`05c083a1-59c8-4b60-8c1f-9381153139a4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:30,303::task::595::TaskManager.Task::(_updateState) Task=`05c083a1-59c8-4b60-8c1f-9381153139a4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:30,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:30,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:30,304::task::990::TaskManager.Task::(_decref) Task=`05c083a1-59c8-4b60-8c1f-9381153139a4`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:31,311::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:31,312::task::595::TaskManager.Task::(_updateState) Task=`c229f666-b387-4ef6-a3cd-fba0680f62da`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:31,312::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:31,312::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:31,313::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:31,313::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:31,313::task::1185::TaskManager.Task::(prepare) Task=`c229f666-b387-4ef6-a3cd-fba0680f62da`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:31,314::task::595::TaskManager.Task::(_updateState) Task=`c229f666-b387-4ef6-a3cd-fba0680f62da`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:31,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:31,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:31,315::task::990::TaskManager.Task::(_decref) Task=`c229f666-b387-4ef6-a3cd-fba0680f62da`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:32,334::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:32,335::task::595::TaskManager.Task::(_updateState) Task=`ebeeca7d-ad48-469b-ac53-6ddbb853050a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:32,336::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:32,336::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:32,336::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:32,337::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:32,337::task::1185::TaskManager.Task::(prepare) Task=`ebeeca7d-ad48-469b-ac53-6ddbb853050a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:32,337::task::595::TaskManager.Task::(_updateState) Task=`ebeeca7d-ad48-469b-ac53-6ddbb853050a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:32,338::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:32,338::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:32,338::task::990::TaskManager.Task::(_decref) Task=`ebeeca7d-ad48-469b-ac53-6ddbb853050a`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:33,351::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:33,352::task::595::TaskManager.Task::(_updateState) Task=`4d050adf-bb21-48e5-94b5-a1cbd39efc93`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:33,353::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:33,353::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:33,353::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:33,354::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:33,354::task::1185::TaskManager.Task::(prepare) Task=`4d050adf-bb21-48e5-94b5-a1cbd39efc93`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:33,354::task::595::TaskManager.Task::(_updateState) Task=`4d050adf-bb21-48e5-94b5-a1cbd39efc93`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:33,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:33,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:33,355::task::990::TaskManager.Task::(_decref) Task=`4d050adf-bb21-48e5-94b5-a1cbd39efc93`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:34,382::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:34,384::task::595::TaskManager.Task::(_updateState) Task=`a42306f2-beab-4f25-ba16-2e172d50cb14`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:34,385::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:34,386::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:34,386::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:34,387::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:34,387::task::1185::TaskManager.Task::(prepare) Task=`a42306f2-beab-4f25-ba16-2e172d50cb14`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:34,388::task::595::TaskManager.Task::(_updateState) Task=`a42306f2-beab-4f25-ba16-2e172d50cb14`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:34,388::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:34,389::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:34,389::task::990::TaskManager.Task::(_decref) Task=`a42306f2-beab-4f25-ba16-2e172d50cb14`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:34,480::task::595::TaskManager.Task::(_updateState) Task=`998a134f-1e7d-4a67-b62d-433155c77e0c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:34,481::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:12:34,482::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '92.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:12:34,483::task::1185::TaskManager.Task::(prepare) Task=`998a134f-1e7d-4a67-b62d-433155c77e0c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '92.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:12:34,483::task::595::TaskManager.Task::(_updateState) Task=`998a134f-1e7d-4a67-b62d-433155c77e0c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:34,484::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:34,484::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:34,486::task::990::TaskManager.Task::(_decref) Task=`998a134f-1e7d-4a67-b62d-433155c77e0c`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:35,399::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:35,401::task::595::TaskManager.Task::(_updateState) Task=`6387ab3c-6bd2-4d30-8467-e336638d719d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:35,404::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:35,405::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:35,405::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:35,406::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:35,406::task::1185::TaskManager.Task::(prepare) Task=`6387ab3c-6bd2-4d30-8467-e336638d719d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:35,407::task::595::TaskManager.Task::(_updateState) Task=`6387ab3c-6bd2-4d30-8467-e336638d719d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:35,407::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:35,407::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:35,408::task::990::TaskManager.Task::(_decref) Task=`6387ab3c-6bd2-4d30-8467-e336638d719d`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:36,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:36,458::task::595::TaskManager.Task::(_updateState) Task=`a4904a32-e300-49f4-92ce-af01500c32d1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:36,458::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:36,458::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:36,459::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:36,459::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:36,459::task::1185::TaskManager.Task::(prepare) Task=`a4904a32-e300-49f4-92ce-af01500c32d1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:36,460::task::595::TaskManager.Task::(_updateState) Task=`a4904a32-e300-49f4-92ce-af01500c32d1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:36,460::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:36,460::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:36,461::task::990::TaskManager.Task::(_decref) Task=`a4904a32-e300-49f4-92ce-af01500c32d1`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:12:37,470::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:12:37,471::task::595::TaskManager.Task::(_updateState) Task=`4b63b00c-bb77-4301-bd02-078285a484fa`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:12:37,471::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:12:37,473::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:12:37,473::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:12:37,474::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:37,474::task::1185::TaskManager.Task::(prepare) Task=`4b63b00c-bb77-4301-bd02-078285a484fa`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:12:37,474::task::595::TaskManager.Task::(_updateState) Task=`4b63b00c-bb77-4301-bd02-078285a484fa`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:12:37,477::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:12:37,477::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:12:37,477::task::990::TaskManager.Task::(_decref) Task=`4b63b00c-bb77-4301-bd02-078285a484fa`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:39,161::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:39,174::task::595::TaskManager.Task::(_updateState) Task=`dc12b0d6-a85c-4259-bd3c-d90d4ffaf4d9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:39,175::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:39,176::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:39,176::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:39,177::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:39,179::task::1185::TaskManager.Task::(prepare) Task=`dc12b0d6-a85c-4259-bd3c-d90d4ffaf4d9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:39,179::task::595::TaskManager.Task::(_updateState) Task=`dc12b0d6-a85c-4259-bd3c-d90d4ffaf4d9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:39,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:39,180::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:39,180::task::990::TaskManager.Task::(_decref) Task=`dc12b0d6-a85c-4259-bd3c-d90d4ffaf4d9`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:40,259::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:40,260::task::595::TaskManager.Task::(_updateState) Task=`2ed7c28b-6ed0-466b-aab6-efd768da52f0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:40,261::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:40,261::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:40,261::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:40,261::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:40,262::task::1185::TaskManager.Task::(prepare) Task=`2ed7c28b-6ed0-466b-aab6-efd768da52f0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:40,262::task::595::TaskManager.Task::(_updateState) Task=`2ed7c28b-6ed0-466b-aab6-efd768da52f0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:40,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:40,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:40,262::task::990::TaskManager.Task::(_decref) Task=`2ed7c28b-6ed0-466b-aab6-efd768da52f0`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:41,269::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:41,279::task::595::TaskManager.Task::(_updateState) Task=`89fd5496-212e-468f-a300-dc3ef5f6c732`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:41,280::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:41,281::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:41,281::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:41,282::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:41,282::task::1185::TaskManager.Task::(prepare) Task=`89fd5496-212e-468f-a300-dc3ef5f6c732`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:41,282::task::595::TaskManager.Task::(_updateState) Task=`89fd5496-212e-468f-a300-dc3ef5f6c732`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:41,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:41,283::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:41,283::task::990::TaskManager.Task::(_decref) Task=`89fd5496-212e-468f-a300-dc3ef5f6c732`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:42,307::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:42,308::task::595::TaskManager.Task::(_updateState) Task=`c1409ca5-8087-4f94-ba6a-b836b83e86eb`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:42,308::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:42,309::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:42,309::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:42,309::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:42,310::task::1185::TaskManager.Task::(prepare) Task=`c1409ca5-8087-4f94-ba6a-b836b83e86eb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:42,310::task::595::TaskManager.Task::(_updateState) Task=`c1409ca5-8087-4f94-ba6a-b836b83e86eb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:42,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:42,311::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:42,311::task::990::TaskManager.Task::(_decref) Task=`c1409ca5-8087-4f94-ba6a-b836b83e86eb`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:43,322::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:43,323::task::595::TaskManager.Task::(_updateState) Task=`ac08b5fb-a155-4086-9537-7ed610dab2f4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:43,323::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:43,323::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:43,324::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:43,324::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:43,324::task::1185::TaskManager.Task::(prepare) Task=`ac08b5fb-a155-4086-9537-7ed610dab2f4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:43,324::task::595::TaskManager.Task::(_updateState) Task=`ac08b5fb-a155-4086-9537-7ed610dab2f4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:43,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:43,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:43,325::task::990::TaskManager.Task::(_decref) Task=`ac08b5fb-a155-4086-9537-7ed610dab2f4`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:44,361::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:44,362::task::595::TaskManager.Task::(_updateState) Task=`b6b71857-8113-4683-b6cd-5147573c5c49`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:44,363::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:44,363::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:44,363::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:44,364::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:44,364::task::1185::TaskManager.Task::(prepare) Task=`b6b71857-8113-4683-b6cd-5147573c5c49`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:44,365::task::595::TaskManager.Task::(_updateState) Task=`b6b71857-8113-4683-b6cd-5147573c5c49`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:44,365::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:44,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:44,366::task::990::TaskManager.Task::(_decref) Task=`b6b71857-8113-4683-b6cd-5147573c5c49`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:45,389::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:45,391::task::595::TaskManager.Task::(_updateState) Task=`ee64f8d1-3fda-4d3e-9eac-3f477f3e0f48`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:45,391::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:45,391::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:45,391::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:45,392::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:45,392::task::1185::TaskManager.Task::(prepare) Task=`ee64f8d1-3fda-4d3e-9eac-3f477f3e0f48`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:45,392::task::595::TaskManager.Task::(_updateState) Task=`ee64f8d1-3fda-4d3e-9eac-3f477f3e0f48`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:45,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:45,393::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:45,393::task::990::TaskManager.Task::(_decref) Task=`ee64f8d1-3fda-4d3e-9eac-3f477f3e0f48`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:46,399::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:46,400::task::595::TaskManager.Task::(_updateState) Task=`c441a3b9-4480-48db-b7c1-8658d4702eb4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:46,400::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:46,401::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:46,401::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:46,401::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:46,402::task::1185::TaskManager.Task::(prepare) Task=`c441a3b9-4480-48db-b7c1-8658d4702eb4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:46,402::task::595::TaskManager.Task::(_updateState) Task=`c441a3b9-4480-48db-b7c1-8658d4702eb4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:46,402::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:46,402::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:46,403::task::990::TaskManager.Task::(_decref) Task=`c441a3b9-4480-48db-b7c1-8658d4702eb4`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:47,423::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:47,437::task::595::TaskManager.Task::(_updateState) Task=`8b6db505-b7aa-497e-be5f-be1912ee88c2`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:47,438::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:47,438::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:47,439::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:47,456::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:47,456::task::1185::TaskManager.Task::(prepare) Task=`8b6db505-b7aa-497e-be5f-be1912ee88c2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:47,456::task::595::TaskManager.Task::(_updateState) Task=`8b6db505-b7aa-497e-be5f-be1912ee88c2`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:47,462::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:47,462::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:47,463::task::990::TaskManager.Task::(_decref) Task=`8b6db505-b7aa-497e-be5f-be1912ee88c2`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:48,490::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:48,491::task::595::TaskManager.Task::(_updateState) Task=`33602adc-569e-49fb-8c4d-05d643f9e549`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:48,491::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:48,491::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:48,491::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:48,492::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:48,492::task::1185::TaskManager.Task::(prepare) Task=`33602adc-569e-49fb-8c4d-05d643f9e549`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:48,492::task::595::TaskManager.Task::(_updateState) Task=`33602adc-569e-49fb-8c4d-05d643f9e549`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:48,494::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:48,494::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:48,494::task::990::TaskManager.Task::(_decref) Task=`33602adc-569e-49fb-8c4d-05d643f9e549`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:49,500::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:49,501::task::595::TaskManager.Task::(_updateState) Task=`72b11d91-7b8c-4b81-b164-a4593522620d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:49,501::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:49,502::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:49,502::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:49,502::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:49,502::task::1185::TaskManager.Task::(prepare) Task=`72b11d91-7b8c-4b81-b164-a4593522620d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:49,502::task::595::TaskManager.Task::(_updateState) Task=`72b11d91-7b8c-4b81-b164-a4593522620d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:49,503::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:49,503::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:49,503::task::990::TaskManager.Task::(_decref) Task=`72b11d91-7b8c-4b81-b164-a4593522620d`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:49,971::task::595::TaskManager.Task::(_updateState) Task=`3bd2e7c6-df8f-4ea4-aafc-01c0433064f9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:49,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:12:49,973::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '108.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:12:49,973::task::1185::TaskManager.Task::(prepare) Task=`3bd2e7c6-df8f-4ea4-aafc-01c0433064f9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '108.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:12:49,973::task::595::TaskManager.Task::(_updateState) Task=`3bd2e7c6-df8f-4ea4-aafc-01c0433064f9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:49,974::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:49,974::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:49,974::task::990::TaskManager.Task::(_decref) Task=`3bd2e7c6-df8f-4ea4-aafc-01c0433064f9`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:50,517::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:50,518::task::595::TaskManager.Task::(_updateState) Task=`aa2b0b4f-114e-45c2-ab9a-71e4d3393638`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:50,519::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:50,519::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:50,519::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:50,519::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:50,519::task::1185::TaskManager.Task::(prepare) Task=`aa2b0b4f-114e-45c2-ab9a-71e4d3393638`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:50,520::task::595::TaskManager.Task::(_updateState) Task=`aa2b0b4f-114e-45c2-ab9a-71e4d3393638`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:50,520::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:50,520::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:50,520::task::990::TaskManager.Task::(_decref) Task=`aa2b0b4f-114e-45c2-ab9a-71e4d3393638`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:51,526::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:51,527::task::595::TaskManager.Task::(_updateState) Task=`8deeaa32-593b-4e80-961d-4c6185b5cab5`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:51,527::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:51,527::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:51,528::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:51,528::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:51,528::task::1185::TaskManager.Task::(prepare) Task=`8deeaa32-593b-4e80-961d-4c6185b5cab5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:51,529::task::595::TaskManager.Task::(_updateState) Task=`8deeaa32-593b-4e80-961d-4c6185b5cab5`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:51,529::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:51,529::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:51,529::task::990::TaskManager.Task::(_decref) Task=`8deeaa32-593b-4e80-961d-4c6185b5cab5`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:52,535::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:52,536::task::595::TaskManager.Task::(_updateState) Task=`5ba691cd-95f1-4ee1-9045-daf685b09054`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:52,537::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:52,537::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:52,537::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:52,538::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:52,538::task::1185::TaskManager.Task::(prepare) Task=`5ba691cd-95f1-4ee1-9045-daf685b09054`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:52,538::task::595::TaskManager.Task::(_updateState) Task=`5ba691cd-95f1-4ee1-9045-daf685b09054`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:52,538::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:52,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:52,539::task::990::TaskManager.Task::(_decref) Task=`5ba691cd-95f1-4ee1-9045-daf685b09054`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:53,591::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:53,592::task::595::TaskManager.Task::(_updateState) Task=`ce6945a2-0f4c-40a0-851a-0332d85bcf84`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:53,593::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:53,593::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:53,593::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:53,593::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:53,594::task::1185::TaskManager.Task::(prepare) Task=`ce6945a2-0f4c-40a0-851a-0332d85bcf84`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:53,594::task::595::TaskManager.Task::(_updateState) Task=`ce6945a2-0f4c-40a0-851a-0332d85bcf84`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:53,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:53,595::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:53,595::task::990::TaskManager.Task::(_decref) Task=`ce6945a2-0f4c-40a0-851a-0332d85bcf84`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:54,746::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:54,747::task::595::TaskManager.Task::(_updateState) Task=`4ff0ac28-27a7-421f-aba6-af77c0cfa32f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:54,748::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:54,748::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:54,748::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:54,749::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:54,749::task::1185::TaskManager.Task::(prepare) Task=`4ff0ac28-27a7-421f-aba6-af77c0cfa32f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:54,750::task::595::TaskManager.Task::(_updateState) Task=`4ff0ac28-27a7-421f-aba6-af77c0cfa32f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:54,750::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:54,750::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:54,750::task::990::TaskManager.Task::(_decref) Task=`4ff0ac28-27a7-421f-aba6-af77c0cfa32f`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:55,770::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:55,772::task::595::TaskManager.Task::(_updateState) Task=`9d3880d5-dbb0-4692-a265-90984b23a9ff`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:55,774::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:55,774::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:55,774::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:55,774::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:55,775::task::1185::TaskManager.Task::(prepare) Task=`9d3880d5-dbb0-4692-a265-90984b23a9ff`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:55,775::task::595::TaskManager.Task::(_updateState) Task=`9d3880d5-dbb0-4692-a265-90984b23a9ff`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:55,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:55,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:55,775::task::990::TaskManager.Task::(_decref) Task=`9d3880d5-dbb0-4692-a265-90984b23a9ff`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:56,782::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:56,783::task::595::TaskManager.Task::(_updateState) Task=`68214ea3-efe2-4afd-84c0-90c9d308a1b3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:56,783::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:56,783::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:56,784::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:56,784::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:56,784::task::1185::TaskManager.Task::(prepare) Task=`68214ea3-efe2-4afd-84c0-90c9d308a1b3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:56,785::task::595::TaskManager.Task::(_updateState) Task=`68214ea3-efe2-4afd-84c0-90c9d308a1b3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:56,785::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:56,785::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:56,785::task::990::TaskManager.Task::(_decref) Task=`68214ea3-efe2-4afd-84c0-90c9d308a1b3`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:57,791::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:57,792::task::595::TaskManager.Task::(_updateState) Task=`23e877c6-6008-48c7-bd36-19f13f239b63`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:57,792::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:57,792::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:57,792::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:57,793::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:57,793::task::1185::TaskManager.Task::(prepare) Task=`23e877c6-6008-48c7-bd36-19f13f239b63`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:57,793::task::595::TaskManager.Task::(_updateState) Task=`23e877c6-6008-48c7-bd36-19f13f239b63`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:57,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:57,793::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:57,793::task::990::TaskManager.Task::(_decref) Task=`23e877c6-6008-48c7-bd36-19f13f239b63`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:58,799::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:58,799::task::595::TaskManager.Task::(_updateState) Task=`faec3be1-1493-49f3-8d79-9ec7df8cc288`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:58,800::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:58,800::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:58,800::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:58,800::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:58,801::task::1185::TaskManager.Task::(prepare) Task=`faec3be1-1493-49f3-8d79-9ec7df8cc288`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:58,801::task::595::TaskManager.Task::(_updateState) Task=`faec3be1-1493-49f3-8d79-9ec7df8cc288`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:58,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:58,801::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:58,801::task::990::TaskManager.Task::(_decref) Task=`faec3be1-1493-49f3-8d79-9ec7df8cc288`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:12:59,811::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:12:59,814::task::595::TaskManager.Task::(_updateState) Task=`020a7318-5c8b-46c4-aa8a-f5b14da51214`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:12:59,815::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:12:59,815::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:12:59,816::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:12:59,816::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:59,817::task::1185::TaskManager.Task::(prepare) Task=`020a7318-5c8b-46c4-aa8a-f5b14da51214`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:12:59,818::task::595::TaskManager.Task::(_updateState) Task=`020a7318-5c8b-46c4-aa8a-f5b14da51214`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:12:59,818::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:12:59,820::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:12:59,823::task::990::TaskManager.Task::(_decref) Task=`020a7318-5c8b-46c4-aa8a-f5b14da51214`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:02,190::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:02,192::task::595::TaskManager.Task::(_updateState) Task=`d43c86ab-38c4-4210-af06-4319e526e76d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:02,193::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:02,193::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:02,194::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:02,194::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:02,195::task::1185::TaskManager.Task::(prepare) Task=`d43c86ab-38c4-4210-af06-4319e526e76d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:02,195::task::595::TaskManager.Task::(_updateState) Task=`d43c86ab-38c4-4210-af06-4319e526e76d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:02,196::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:02,196::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:02,197::task::990::TaskManager.Task::(_decref) Task=`d43c86ab-38c4-4210-af06-4319e526e76d`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:03,208::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:03,209::task::595::TaskManager.Task::(_updateState) Task=`041f3b6f-a767-40bd-87be-24f74b8ab53c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:03,210::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:03,210::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:03,210::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:03,211::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:03,211::task::1185::TaskManager.Task::(prepare) Task=`041f3b6f-a767-40bd-87be-24f74b8ab53c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:03,211::task::595::TaskManager.Task::(_updateState) Task=`041f3b6f-a767-40bd-87be-24f74b8ab53c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:03,212::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:03,212::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:03,212::task::990::TaskManager.Task::(_decref) Task=`041f3b6f-a767-40bd-87be-24f74b8ab53c`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:04,310::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:04,311::task::595::TaskManager.Task::(_updateState) Task=`b3c74388-58b1-4b0d-9abe-85b02f8ed425`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:04,311::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:04,311::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:04,312::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:04,312::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:04,312::task::1185::TaskManager.Task::(prepare) Task=`b3c74388-58b1-4b0d-9abe-85b02f8ed425`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:04,312::task::595::TaskManager.Task::(_updateState) Task=`b3c74388-58b1-4b0d-9abe-85b02f8ed425`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:04,313::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:04,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:04,313::task::990::TaskManager.Task::(_decref) Task=`b3c74388-58b1-4b0d-9abe-85b02f8ed425`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:06,348::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:12,313::task::595::TaskManager.Task::(_updateState) Task=`fa6a2f9f-8787-4020-9c37-ed659cd943c3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:12,316::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::DEBUG::2014-08-21 11:13:12,316::task::595::TaskManager.Task::(_updateState) Task=`b76f7f82-7fcc-48d3-b8b3-01fe583b0bb7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:12,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '130.7', 'valid': True}}
>Thread-13::INFO::2014-08-21 11:13:12,340::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:12,350::task::1185::TaskManager.Task::(prepare) Task=`fa6a2f9f-8787-4020-9c37-ed659cd943c3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '130.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:13:12,353::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:12,354::task::595::TaskManager.Task::(_updateState) Task=`fa6a2f9f-8787-4020-9c37-ed659cd943c3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:12,355::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:12,362::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:12,363::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:12,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:12,373::task::1185::TaskManager.Task::(prepare) Task=`b76f7f82-7fcc-48d3-b8b3-01fe583b0bb7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:12,412::task::990::TaskManager.Task::(_decref) Task=`fa6a2f9f-8787-4020-9c37-ed659cd943c3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:12,430::task::595::TaskManager.Task::(_updateState) Task=`b76f7f82-7fcc-48d3-b8b3-01fe583b0bb7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:12,436::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:12,437::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:12,438::task::990::TaskManager.Task::(_decref) Task=`b76f7f82-7fcc-48d3-b8b3-01fe583b0bb7`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:13,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:13,458::task::595::TaskManager.Task::(_updateState) Task=`323a850b-d93d-4331-a5ca-66eb78567523`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:13,458::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:13,459::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:13,459::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:13,459::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:13,459::task::1185::TaskManager.Task::(prepare) Task=`323a850b-d93d-4331-a5ca-66eb78567523`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:13,460::task::595::TaskManager.Task::(_updateState) Task=`323a850b-d93d-4331-a5ca-66eb78567523`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:13,461::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:13,461::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:13,461::task::990::TaskManager.Task::(_decref) Task=`323a850b-d93d-4331-a5ca-66eb78567523`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:14,487::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:14,488::task::595::TaskManager.Task::(_updateState) Task=`893f9df6-18b3-4c38-875c-eef8ef3e0394`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:14,488::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:14,489::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:14,489::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:14,489::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:14,490::task::1185::TaskManager.Task::(prepare) Task=`893f9df6-18b3-4c38-875c-eef8ef3e0394`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:14,490::task::595::TaskManager.Task::(_updateState) Task=`893f9df6-18b3-4c38-875c-eef8ef3e0394`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:14,490::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:14,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:14,491::task::990::TaskManager.Task::(_decref) Task=`893f9df6-18b3-4c38-875c-eef8ef3e0394`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:15,525::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:15,526::task::595::TaskManager.Task::(_updateState) Task=`e56e9ac3-9171-4e78-adf6-6c1252d26f58`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:15,526::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:15,527::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:15,527::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:15,527::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:15,528::task::1185::TaskManager.Task::(prepare) Task=`e56e9ac3-9171-4e78-adf6-6c1252d26f58`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:15,528::task::595::TaskManager.Task::(_updateState) Task=`e56e9ac3-9171-4e78-adf6-6c1252d26f58`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:15,528::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:15,528::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:15,529::task::990::TaskManager.Task::(_decref) Task=`e56e9ac3-9171-4e78-adf6-6c1252d26f58`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:16,547::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:16,548::task::595::TaskManager.Task::(_updateState) Task=`b2384bed-16a7-4905-89dd-dee2359eb5ae`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:16,549::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:16,549::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:16,549::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:16,549::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:16,550::task::1185::TaskManager.Task::(prepare) Task=`b2384bed-16a7-4905-89dd-dee2359eb5ae`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:16,550::task::595::TaskManager.Task::(_updateState) Task=`b2384bed-16a7-4905-89dd-dee2359eb5ae`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:16,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:16,551::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:16,551::task::990::TaskManager.Task::(_decref) Task=`b2384bed-16a7-4905-89dd-dee2359eb5ae`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:17,586::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:17,587::task::595::TaskManager.Task::(_updateState) Task=`a54eeda2-6c8c-4b1e-a604-5b12891b9442`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:17,588::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:17,588::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:17,589::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:17,589::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:17,589::task::1185::TaskManager.Task::(prepare) Task=`a54eeda2-6c8c-4b1e-a604-5b12891b9442`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:17,589::task::595::TaskManager.Task::(_updateState) Task=`a54eeda2-6c8c-4b1e-a604-5b12891b9442`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:17,590::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:17,590::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:17,590::task::990::TaskManager.Task::(_decref) Task=`a54eeda2-6c8c-4b1e-a604-5b12891b9442`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:18,596::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:18,597::task::595::TaskManager.Task::(_updateState) Task=`92ed43a8-e7b1-48ec-97b1-9a868c242abd`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:18,597::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:18,597::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:18,597::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:18,598::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:18,598::task::1185::TaskManager.Task::(prepare) Task=`92ed43a8-e7b1-48ec-97b1-9a868c242abd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:18,598::task::595::TaskManager.Task::(_updateState) Task=`92ed43a8-e7b1-48ec-97b1-9a868c242abd`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:18,598::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:18,599::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:18,599::task::990::TaskManager.Task::(_decref) Task=`92ed43a8-e7b1-48ec-97b1-9a868c242abd`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:19,604::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:19,605::task::595::TaskManager.Task::(_updateState) Task=`c3439cd2-efeb-432c-8bbc-f5204e810f71`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:19,605::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:19,606::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:19,606::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:19,606::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:19,606::task::1185::TaskManager.Task::(prepare) Task=`c3439cd2-efeb-432c-8bbc-f5204e810f71`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:19,607::task::595::TaskManager.Task::(_updateState) Task=`c3439cd2-efeb-432c-8bbc-f5204e810f71`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:19,607::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:19,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:19,607::task::990::TaskManager.Task::(_decref) Task=`c3439cd2-efeb-432c-8bbc-f5204e810f71`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:20,613::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:20,619::task::595::TaskManager.Task::(_updateState) Task=`879c0140-21f4-4dd1-93d5-5eff9240590b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:20,619::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:20,620::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:20,620::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:20,620::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:20,621::task::1185::TaskManager.Task::(prepare) Task=`879c0140-21f4-4dd1-93d5-5eff9240590b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:20,621::task::595::TaskManager.Task::(_updateState) Task=`879c0140-21f4-4dd1-93d5-5eff9240590b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:20,621::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:20,622::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:20,622::task::990::TaskManager.Task::(_decref) Task=`879c0140-21f4-4dd1-93d5-5eff9240590b`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:21,637::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:21,638::task::595::TaskManager.Task::(_updateState) Task=`1c5e5a9f-3c77-45c6-b33c-2b155676c6eb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:21,638::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:21,638::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:21,639::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:21,639::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:21,639::task::1185::TaskManager.Task::(prepare) Task=`1c5e5a9f-3c77-45c6-b33c-2b155676c6eb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:21,640::task::595::TaskManager.Task::(_updateState) Task=`1c5e5a9f-3c77-45c6-b33c-2b155676c6eb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:21,640::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:21,640::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:21,640::task::990::TaskManager.Task::(_decref) Task=`1c5e5a9f-3c77-45c6-b33c-2b155676c6eb`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:22,789::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:22,791::task::595::TaskManager.Task::(_updateState) Task=`1ee4f2ba-e615-4471-8b7b-c9199c26bb5a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:22,792::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:22,792::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:22,792::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:22,959::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:22,960::task::1185::TaskManager.Task::(prepare) Task=`1ee4f2ba-e615-4471-8b7b-c9199c26bb5a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:22,960::task::595::TaskManager.Task::(_updateState) Task=`1ee4f2ba-e615-4471-8b7b-c9199c26bb5a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:22,961::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:22,961::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:22,994::task::990::TaskManager.Task::(_decref) Task=`1ee4f2ba-e615-4471-8b7b-c9199c26bb5a`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:24,001::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:24,002::task::595::TaskManager.Task::(_updateState) Task=`4a5d34fc-e5d5-4d3e-a5e0-20580d541b78`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:24,002::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:24,002::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:24,003::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:24,003::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:24,003::task::1185::TaskManager.Task::(prepare) Task=`4a5d34fc-e5d5-4d3e-a5e0-20580d541b78`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:24,004::task::595::TaskManager.Task::(_updateState) Task=`4a5d34fc-e5d5-4d3e-a5e0-20580d541b78`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:24,004::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:24,004::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:24,005::task::990::TaskManager.Task::(_decref) Task=`4a5d34fc-e5d5-4d3e-a5e0-20580d541b78`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:25,011::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:25,013::task::595::TaskManager.Task::(_updateState) Task=`8fe5e975-314e-4c7f-8ae5-41d54495dc7f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:25,013::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:25,013::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:25,014::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:25,014::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:25,014::task::1185::TaskManager.Task::(prepare) Task=`8fe5e975-314e-4c7f-8ae5-41d54495dc7f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:25,015::task::595::TaskManager.Task::(_updateState) Task=`8fe5e975-314e-4c7f-8ae5-41d54495dc7f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:25,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:25,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:25,016::task::990::TaskManager.Task::(_decref) Task=`8fe5e975-314e-4c7f-8ae5-41d54495dc7f`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:26,031::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:26,032::task::595::TaskManager.Task::(_updateState) Task=`332f0ded-3c8f-4dca-bb6b-2fd49d6cb8d9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:26,032::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:26,032::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:26,034::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:26,034::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:26,035::task::1185::TaskManager.Task::(prepare) Task=`332f0ded-3c8f-4dca-bb6b-2fd49d6cb8d9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:26,035::task::595::TaskManager.Task::(_updateState) Task=`332f0ded-3c8f-4dca-bb6b-2fd49d6cb8d9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:26,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:26,036::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:26,036::task::990::TaskManager.Task::(_decref) Task=`332f0ded-3c8f-4dca-bb6b-2fd49d6cb8d9`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:27,044::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:27,046::task::595::TaskManager.Task::(_updateState) Task=`f13681ad-d77c-45be-9ca8-0f4f035218d2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:27,046::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:27,047::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:27,047::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:27,047::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:27,047::task::1185::TaskManager.Task::(prepare) Task=`f13681ad-d77c-45be-9ca8-0f4f035218d2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:27,048::task::595::TaskManager.Task::(_updateState) Task=`f13681ad-d77c-45be-9ca8-0f4f035218d2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:27,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:27,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:27,049::task::990::TaskManager.Task::(_decref) Task=`f13681ad-d77c-45be-9ca8-0f4f035218d2`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:27,579::task::595::TaskManager.Task::(_updateState) Task=`b1005853-0731-41fc-a2d4-8aa2ff25a94d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:27,580::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:13:27,580::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '146.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:13:27,591::task::1185::TaskManager.Task::(prepare) Task=`b1005853-0731-41fc-a2d4-8aa2ff25a94d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '146.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:13:27,593::task::595::TaskManager.Task::(_updateState) Task=`b1005853-0731-41fc-a2d4-8aa2ff25a94d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:27,593::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:27,593::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:27,593::task::990::TaskManager.Task::(_decref) Task=`b1005853-0731-41fc-a2d4-8aa2ff25a94d`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:28,064::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:28,066::task::595::TaskManager.Task::(_updateState) Task=`bffd41ce-da46-4ebe-8bbe-6d649ad0329f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:28,066::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:28,071::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:28,072::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:28,072::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:28,073::task::1185::TaskManager.Task::(prepare) Task=`bffd41ce-da46-4ebe-8bbe-6d649ad0329f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:28,073::task::595::TaskManager.Task::(_updateState) Task=`bffd41ce-da46-4ebe-8bbe-6d649ad0329f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:28,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:28,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:28,075::task::990::TaskManager.Task::(_decref) Task=`bffd41ce-da46-4ebe-8bbe-6d649ad0329f`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:29,089::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:29,090::task::595::TaskManager.Task::(_updateState) Task=`993b315a-33f2-4df2-8a62-7e6363ccec3d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:29,090::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:29,090::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:29,090::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:29,091::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:29,091::task::1185::TaskManager.Task::(prepare) Task=`993b315a-33f2-4df2-8a62-7e6363ccec3d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:29,091::task::595::TaskManager.Task::(_updateState) Task=`993b315a-33f2-4df2-8a62-7e6363ccec3d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:29,091::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:29,091::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:29,092::task::990::TaskManager.Task::(_decref) Task=`993b315a-33f2-4df2-8a62-7e6363ccec3d`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:30,097::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:30,098::task::595::TaskManager.Task::(_updateState) Task=`313cb570-d4c3-4ea6-9d30-6bfde6fa8b72`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:30,099::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:30,099::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:30,099::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:30,099::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:30,099::task::1185::TaskManager.Task::(prepare) Task=`313cb570-d4c3-4ea6-9d30-6bfde6fa8b72`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:30,100::task::595::TaskManager.Task::(_updateState) Task=`313cb570-d4c3-4ea6-9d30-6bfde6fa8b72`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:30,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:30,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:30,100::task::990::TaskManager.Task::(_decref) Task=`313cb570-d4c3-4ea6-9d30-6bfde6fa8b72`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:31,106::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:31,106::task::595::TaskManager.Task::(_updateState) Task=`dd2718df-91eb-44f1-a239-a7cd0db08995`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:31,107::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:31,107::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:31,107::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:31,107::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:31,107::task::1185::TaskManager.Task::(prepare) Task=`dd2718df-91eb-44f1-a239-a7cd0db08995`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:31,108::task::595::TaskManager.Task::(_updateState) Task=`dd2718df-91eb-44f1-a239-a7cd0db08995`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:31,108::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:31,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:31,108::task::990::TaskManager.Task::(_decref) Task=`dd2718df-91eb-44f1-a239-a7cd0db08995`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:32,113::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:32,114::task::595::TaskManager.Task::(_updateState) Task=`9af1c2e9-2f78-47a7-b64b-5f6ea67f3ddd`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:32,114::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:32,114::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:32,115::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:32,115::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:32,115::task::1185::TaskManager.Task::(prepare) Task=`9af1c2e9-2f78-47a7-b64b-5f6ea67f3ddd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:32,115::task::595::TaskManager.Task::(_updateState) Task=`9af1c2e9-2f78-47a7-b64b-5f6ea67f3ddd`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:32,115::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:32,115::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:32,116::task::990::TaskManager.Task::(_decref) Task=`9af1c2e9-2f78-47a7-b64b-5f6ea67f3ddd`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:33,125::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:33,127::task::595::TaskManager.Task::(_updateState) Task=`7c9ef91f-0cf6-4d51-b843-39226a765077`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:33,127::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:33,128::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:33,128::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:33,128::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:33,128::task::1185::TaskManager.Task::(prepare) Task=`7c9ef91f-0cf6-4d51-b843-39226a765077`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:33,129::task::595::TaskManager.Task::(_updateState) Task=`7c9ef91f-0cf6-4d51-b843-39226a765077`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:33,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:33,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:33,129::task::990::TaskManager.Task::(_decref) Task=`7c9ef91f-0cf6-4d51-b843-39226a765077`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:34,323::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:34,402::task::595::TaskManager.Task::(_updateState) Task=`f4a263c3-9294-4a7c-adaf-b7f9fa6d0909`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:34,528::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:34,812::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:34,813::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:34,813::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:34,814::task::1185::TaskManager.Task::(prepare) Task=`f4a263c3-9294-4a7c-adaf-b7f9fa6d0909`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:34,877::task::595::TaskManager.Task::(_updateState) Task=`f4a263c3-9294-4a7c-adaf-b7f9fa6d0909`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:34,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:34,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:34,965::task::990::TaskManager.Task::(_decref) Task=`f4a263c3-9294-4a7c-adaf-b7f9fa6d0909`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:36,449::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:36,450::task::595::TaskManager.Task::(_updateState) Task=`ea705e74-9f09-47f2-bcc5-31f6cd02d73c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:36,450::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:36,451::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:36,451::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:36,451::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:36,451::task::1185::TaskManager.Task::(prepare) Task=`ea705e74-9f09-47f2-bcc5-31f6cd02d73c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:36,451::task::595::TaskManager.Task::(_updateState) Task=`ea705e74-9f09-47f2-bcc5-31f6cd02d73c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:36,452::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:36,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:36,452::task::990::TaskManager.Task::(_decref) Task=`ea705e74-9f09-47f2-bcc5-31f6cd02d73c`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:37,462::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:37,463::task::595::TaskManager.Task::(_updateState) Task=`991a3cae-f517-4850-85f7-ad2eecbc2e4f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:37,463::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:37,464::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:37,464::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:37,464::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:37,464::task::1185::TaskManager.Task::(prepare) Task=`991a3cae-f517-4850-85f7-ad2eecbc2e4f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:37,465::task::595::TaskManager.Task::(_updateState) Task=`991a3cae-f517-4850-85f7-ad2eecbc2e4f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:37,465::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:37,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:37,466::task::990::TaskManager.Task::(_decref) Task=`991a3cae-f517-4850-85f7-ad2eecbc2e4f`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:38,483::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:38,484::task::595::TaskManager.Task::(_updateState) Task=`71c2a5b9-4521-47a0-81b8-65d248378d0a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:38,485::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:38,485::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:38,485::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:38,486::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:38,486::task::1185::TaskManager.Task::(prepare) Task=`71c2a5b9-4521-47a0-81b8-65d248378d0a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:38,486::task::595::TaskManager.Task::(_updateState) Task=`71c2a5b9-4521-47a0-81b8-65d248378d0a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:38,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:38,487::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:38,488::task::990::TaskManager.Task::(_decref) Task=`71c2a5b9-4521-47a0-81b8-65d248378d0a`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:13:39,509::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 11:13:39,510::task::595::TaskManager.Task::(_updateState) Task=`548df2d5-05d5-4b58-93da-59a8fd6390d7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:13:39,510::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-13::DEBUG::2014-08-21 11:13:39,510::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-13::DEBUG::2014-08-21 11:13:39,511::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-13::INFO::2014-08-21 11:13:39,511::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:39,511::task::1185::TaskManager.Task::(prepare) Task=`548df2d5-05d5-4b58-93da-59a8fd6390d7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-13::DEBUG::2014-08-21 11:13:39,512::task::595::TaskManager.Task::(_updateState) Task=`548df2d5-05d5-4b58-93da-59a8fd6390d7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:13:39,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:13:39,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:13:39,512::task::990::TaskManager.Task::(_decref) Task=`548df2d5-05d5-4b58-93da-59a8fd6390d7`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:41,319::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:41,321::task::595::TaskManager.Task::(_updateState) Task=`540b14c2-0145-4a92-91c9-3114d5718a90`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:41,322::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:41,322::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:41,323::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:41,323::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:41,323::task::1185::TaskManager.Task::(prepare) Task=`540b14c2-0145-4a92-91c9-3114d5718a90`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:41,324::task::595::TaskManager.Task::(_updateState) Task=`540b14c2-0145-4a92-91c9-3114d5718a90`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:41,324::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:41,324::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:41,325::task::990::TaskManager.Task::(_decref) Task=`540b14c2-0145-4a92-91c9-3114d5718a90`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:42,350::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:42,355::task::595::TaskManager.Task::(_updateState) Task=`4a308cb1-cbe2-4ece-afa0-8d02212f359f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:42,356::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:42,356::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:42,356::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:42,357::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:42,357::task::1185::TaskManager.Task::(prepare) Task=`4a308cb1-cbe2-4ece-afa0-8d02212f359f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:42,357::task::595::TaskManager.Task::(_updateState) Task=`4a308cb1-cbe2-4ece-afa0-8d02212f359f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:42,357::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:42,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:42,358::task::990::TaskManager.Task::(_decref) Task=`4a308cb1-cbe2-4ece-afa0-8d02212f359f`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:43,582::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:43,584::task::595::TaskManager.Task::(_updateState) Task=`2db0edf3-9a70-4a79-a954-6f3fdef0c6b4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:43,585::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:43,585::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:43,585::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:43,586::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:43,586::task::1185::TaskManager.Task::(prepare) Task=`2db0edf3-9a70-4a79-a954-6f3fdef0c6b4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:43,586::task::595::TaskManager.Task::(_updateState) Task=`2db0edf3-9a70-4a79-a954-6f3fdef0c6b4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:43,587::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:43,587::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:43,587::task::990::TaskManager.Task::(_decref) Task=`2db0edf3-9a70-4a79-a954-6f3fdef0c6b4`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:44,327::task::595::TaskManager.Task::(_updateState) Task=`70ee485b-e468-4867-a371-48e016aa19ba`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:44,328::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:13:44,329::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '162.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:13:44,330::task::1185::TaskManager.Task::(prepare) Task=`70ee485b-e468-4867-a371-48e016aa19ba`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00147667', 'lastCheck': '162.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:13:44,330::task::595::TaskManager.Task::(_updateState) Task=`70ee485b-e468-4867-a371-48e016aa19ba`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:44,330::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:44,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:44,331::task::990::TaskManager.Task::(_decref) Task=`70ee485b-e468-4867-a371-48e016aa19ba`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:44,593::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:44,593::task::595::TaskManager.Task::(_updateState) Task=`5ccbca65-1f02-47ad-abe0-f0d2e8e0ec97`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:44,594::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:44,594::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:44,594::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:44,594::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:44,594::task::1185::TaskManager.Task::(prepare) Task=`5ccbca65-1f02-47ad-abe0-f0d2e8e0ec97`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:44,595::task::595::TaskManager.Task::(_updateState) Task=`5ccbca65-1f02-47ad-abe0-f0d2e8e0ec97`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:44,595::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:44,595::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:44,595::task::990::TaskManager.Task::(_decref) Task=`5ccbca65-1f02-47ad-abe0-f0d2e8e0ec97`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:45,600::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:45,601::task::595::TaskManager.Task::(_updateState) Task=`1329f841-bf02-46c7-86a3-d92d2d813f1c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:45,601::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:45,601::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:45,602::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:45,602::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:45,602::task::1185::TaskManager.Task::(prepare) Task=`1329f841-bf02-46c7-86a3-d92d2d813f1c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:45,602::task::595::TaskManager.Task::(_updateState) Task=`1329f841-bf02-46c7-86a3-d92d2d813f1c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:45,602::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:45,602::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:45,603::task::990::TaskManager.Task::(_decref) Task=`1329f841-bf02-46c7-86a3-d92d2d813f1c`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:47,505::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:47,540::task::595::TaskManager.Task::(_updateState) Task=`b013e41a-628e-4e16-bc36-e6d3c375c408`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:47,541::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:47,542::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:47,543::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:47,543::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:47,544::task::1185::TaskManager.Task::(prepare) Task=`b013e41a-628e-4e16-bc36-e6d3c375c408`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:47,544::task::595::TaskManager.Task::(_updateState) Task=`b013e41a-628e-4e16-bc36-e6d3c375c408`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:47,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:47,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:47,545::task::990::TaskManager.Task::(_decref) Task=`b013e41a-628e-4e16-bc36-e6d3c375c408`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:50,006::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:50,012::task::595::TaskManager.Task::(_updateState) Task=`d8701456-4665-47ea-acfb-40b9a76c6505`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:50,014::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:50,014::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:50,015::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:50,015::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:50,015::task::1185::TaskManager.Task::(prepare) Task=`d8701456-4665-47ea-acfb-40b9a76c6505`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:50,016::task::595::TaskManager.Task::(_updateState) Task=`d8701456-4665-47ea-acfb-40b9a76c6505`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:50,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:50,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:50,026::task::990::TaskManager.Task::(_decref) Task=`d8701456-4665-47ea-acfb-40b9a76c6505`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:51,091::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:51,093::task::595::TaskManager.Task::(_updateState) Task=`d3310057-db5f-41fa-96ca-9e12c29c5030`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:51,093::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:51,094::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:51,094::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:51,094::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:51,095::task::1185::TaskManager.Task::(prepare) Task=`d3310057-db5f-41fa-96ca-9e12c29c5030`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:51,095::task::595::TaskManager.Task::(_updateState) Task=`d3310057-db5f-41fa-96ca-9e12c29c5030`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:51,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:51,096::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:51,096::task::990::TaskManager.Task::(_decref) Task=`d3310057-db5f-41fa-96ca-9e12c29c5030`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:52,107::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:52,108::task::595::TaskManager.Task::(_updateState) Task=`b43e47af-aea7-4158-82e3-c98b1ed2fbd0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:52,109::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:52,109::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:52,109::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:52,109::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:52,110::task::1185::TaskManager.Task::(prepare) Task=`b43e47af-aea7-4158-82e3-c98b1ed2fbd0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:52,110::task::595::TaskManager.Task::(_updateState) Task=`b43e47af-aea7-4158-82e3-c98b1ed2fbd0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:52,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:52,110::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:52,110::task::990::TaskManager.Task::(_decref) Task=`b43e47af-aea7-4158-82e3-c98b1ed2fbd0`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:53,121::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:53,125::task::595::TaskManager.Task::(_updateState) Task=`4f233dc9-3316-4e23-8924-d7b23582b1c8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:53,126::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:53,127::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:53,129::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:53,133::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:53,134::task::1185::TaskManager.Task::(prepare) Task=`4f233dc9-3316-4e23-8924-d7b23582b1c8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:53,136::task::595::TaskManager.Task::(_updateState) Task=`4f233dc9-3316-4e23-8924-d7b23582b1c8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:53,137::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:53,138::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:53,140::task::990::TaskManager.Task::(_decref) Task=`4f233dc9-3316-4e23-8924-d7b23582b1c8`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:54,339::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:54,341::task::595::TaskManager.Task::(_updateState) Task=`ac160fdf-bab4-42f6-a72d-9a20188d5d87`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:54,341::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:54,341::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:54,342::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:54,342::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:54,342::task::1185::TaskManager.Task::(prepare) Task=`ac160fdf-bab4-42f6-a72d-9a20188d5d87`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:54,343::task::595::TaskManager.Task::(_updateState) Task=`ac160fdf-bab4-42f6-a72d-9a20188d5d87`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:54,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:54,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:54,343::task::990::TaskManager.Task::(_decref) Task=`ac160fdf-bab4-42f6-a72d-9a20188d5d87`::ref 0 aborting False
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,363::clusterlock::202::SANLock::(acquireHostId) Host id for domain 664aab68-c780-4f9b-9553-a35e801fdb8b successfully acquired (id: 1)
>264a4ef3-c927-4078-a89e-83ba4d724e50::INFO::2014-08-21 11:13:55,377::clusterlock::235::SANLock::(acquire) Acquiring cluster lock for domain 664aab68-c780-4f9b-9553-a35e801fdb8b (id: 1)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,504::clusterlock::261::SANLock::(acquire) Cluster lock for domain 664aab68-c780-4f9b-9553-a35e801fdb8b successfully acquired (id: 1)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,504::sp::275::Storage.StoragePool::(startSpm) spm lock acquired successfully
>Thread-26::DEBUG::2014-08-21 11:13:55,526::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:55,527::task::595::TaskManager.Task::(_updateState) Task=`ba963a34-e2ab-4dea-96f9-d09f316b1050`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:55,528::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:55,528::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:55,528::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:55,529::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:55,529::task::1185::TaskManager.Task::(prepare) Task=`ba963a34-e2ab-4dea-96f9-d09f316b1050`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:55,529::task::595::TaskManager.Task::(_updateState) Task=`ba963a34-e2ab-4dea-96f9-d09f316b1050`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:55,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:55,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:55,530::task::990::TaskManager.Task::(_decref) Task=`ba963a34-e2ab-4dea-96f9-d09f316b1050`::ref 0 aborting False
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,537::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=35', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6c5381aa447fef18126e84cd8d134725ff0f99ff']
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,538::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,539::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,539::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,549::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,550::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9c06636a-a6ed-4463-88fe-15edf6dd0224`::Request was made in '/usr/share/vdsm/storage/sp.py' line '429' at '_upgradePool'
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,551::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'exclusive'
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,551::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.upgrade_80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'exclusive' (1 active user)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,552::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.upgrade_80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9c06636a-a6ed-4463-88fe-15edf6dd0224`::Granted request
>264a4ef3-c927-4078-a89e-83ba4d724e50::INFO::2014-08-21 11:13:55,553::sp::435::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `664aab68-c780-4f9b-9553-a35e801fdb8b`
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,553::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.664aab68-c780-4f9b-9553-a35e801fdb8b`ReqID=`259ec0fa-3b09-4493-9d4e-f17903587749`::Request was made in '/usr/share/vdsm/storage/sp.py' line '437' at '_upgradePool'
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,554::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.664aab68-c780-4f9b-9553-a35e801fdb8b' for lock type 'exclusive'
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,554::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.664aab68-c780-4f9b-9553-a35e801fdb8b' is free. Now locking as 'exclusive' (1 active user)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,555::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.664aab68-c780-4f9b-9553-a35e801fdb8b`ReqID=`259ec0fa-3b09-4493-9d4e-f17903587749`::Granted request
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,567::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,571::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,587::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,592::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>264a4ef3-c927-4078-a89e-83ba4d724e50::INFO::2014-08-21 11:13:55,593::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>264a4ef3-c927-4078-a89e-83ba4d724e50::INFO::2014-08-21 11:13:55,593::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,593::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.664aab68-c780-4f9b-9553-a35e801fdb8b'
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,594::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.664aab68-c780-4f9b-9553-a35e801fdb8b' (0 active users)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,594::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.664aab68-c780-4f9b-9553-a35e801fdb8b' is free, finding out if anyone is waiting for it.
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,594::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.664aab68-c780-4f9b-9553-a35e801fdb8b', Clearing records.
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,594::sp::440::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,602::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,603::sp::447::Storage.StoragePool::(_upgradePool) Registering with state change event
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,603::sp::450::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,603::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,603::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,604::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.upgrade_80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,604::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,605::sd::633::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/master/vms
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,606::sd::636::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/master/tasks
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,616::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,625::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,631::storage_mailbox::574::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1']
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,631::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,726::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0709246 s, 14.4 MB/s\n'; <rc> = 0
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,727::storage_mailbox::582::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 80a3d808-3945-4db3-91ed-9a8fd0e1e9f8
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,728::sp::322::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 on master domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,729::sp::330::Storage.StoragePool::(startSpm) ended.
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,730::task::595::TaskManager.Task::(_updateState) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::moving from state running -> state finished
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,732::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,733::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Dummy-33::DEBUG::2014-08-21 11:13:55,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,734::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,747::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,748::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,749::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,749::task::913::TaskManager.Task::(_runJobs) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::Task.run: exit - success: result 
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,749::task::990::TaskManager.Task::(_decref) Task=`264a4ef3-c927-4078-a89e-83ba4d724e50`::ref 0 aborting False
>264a4ef3-c927-4078-a89e-83ba4d724e50::DEBUG::2014-08-21 11:13:55,749::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
>Dummy-33::DEBUG::2014-08-21 11:13:55,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483915 s, 21.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:13:56,540::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:56,541::task::595::TaskManager.Task::(_updateState) Task=`f313cfd5-ec4f-4f5d-a6e4-e3d63002fbae`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:56,541::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:56,541::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:56,541::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}
>Thread-26::INFO::2014-08-21 11:13:56,542::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:56,542::task::1185::TaskManager.Task::(prepare) Task=`f313cfd5-ec4f-4f5d-a6e4-e3d63002fbae`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '264a4ef3-c927-4078-a89e-83ba4d724e50'}}
>Thread-26::DEBUG::2014-08-21 11:13:56,542::task::595::TaskManager.Task::(_updateState) Task=`f313cfd5-ec4f-4f5d-a6e4-e3d63002fbae`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:56,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:56,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:56,542::task::990::TaskManager.Task::(_decref) Task=`f313cfd5-ec4f-4f5d-a6e4-e3d63002fbae`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:56,546::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:56,547::task::595::TaskManager.Task::(_updateState) Task=`6f60fec9-e16b-4b37-8dab-46505c997651`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:56,547::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:13:56,547::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:13:56,548::task::1185::TaskManager.Task::(prepare) Task=`6f60fec9-e16b-4b37-8dab-46505c997651`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:13:56,548::task::595::TaskManager.Task::(_updateState) Task=`6f60fec9-e16b-4b37-8dab-46505c997651`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:56,548::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:56,548::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:56,548::task::990::TaskManager.Task::(_decref) Task=`6f60fec9-e16b-4b37-8dab-46505c997651`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:56,594::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:56,594::task::595::TaskManager.Task::(_updateState) Task=`83fc84fc-aea1-42a2-a611-a6a658a83817`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:56,595::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='264a4ef3-c927-4078-a89e-83ba4d724e50', spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:56,595::taskManager::161::TaskManager::(clearTask) Entry. taskID: 264a4ef3-c927-4078-a89e-83ba4d724e50
>Thread-26::DEBUG::2014-08-21 11:13:56,595::taskManager::166::TaskManager::(clearTask) Return.
>Thread-26::INFO::2014-08-21 11:13:56,595::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-26::DEBUG::2014-08-21 11:13:56,596::task::1185::TaskManager.Task::(prepare) Task=`83fc84fc-aea1-42a2-a611-a6a658a83817`::finished: None
>Thread-26::DEBUG::2014-08-21 11:13:56,596::task::595::TaskManager.Task::(_updateState) Task=`83fc84fc-aea1-42a2-a611-a6a658a83817`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:56,596::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:56,596::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:56,596::task::990::TaskManager.Task::(_decref) Task=`83fc84fc-aea1-42a2-a611-a6a658a83817`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:13:56,688::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-34::DEBUG::2014-08-21 11:13:56,689::task::595::TaskManager.Task::(_updateState) Task=`1d6fa488-be74-4dd0-8f86-6ce589b78ed5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:13:56,689::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:13:56,690::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9fe02a0b-5b4e-4b5e-8eb6-6c9aa0dcbb05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:13:56,690::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:13:56,690::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:13:56,690::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9fe02a0b-5b4e-4b5e-8eb6-6c9aa0dcbb05`::Granted request
>Thread-34::DEBUG::2014-08-21 11:13:56,691::task::827::TaskManager.Task::(resourceAcquired) Task=`1d6fa488-be74-4dd0-8f86-6ce589b78ed5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:13:56,691::task::990::TaskManager.Task::(_decref) Task=`1d6fa488-be74-4dd0-8f86-6ce589b78ed5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:13:56,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895474176', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:13:56,695::task::1185::TaskManager.Task::(prepare) Task=`1d6fa488-be74-4dd0-8f86-6ce589b78ed5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895474176', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:13:56,696::task::595::TaskManager.Task::(_updateState) Task=`1d6fa488-be74-4dd0-8f86-6ce589b78ed5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:13:56,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:13:56,696::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:13:56,697::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:13:56,697::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:13:56,697::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:13:56,698::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:13:56,698::task::990::TaskManager.Task::(_decref) Task=`1d6fa488-be74-4dd0-8f86-6ce589b78ed5`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:13:56,726::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 11:13:56,727::task::595::TaskManager.Task::(_updateState) Task=`6cb44417-94ae-4402-baa9-380b310de5c2`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:56,728::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksInfo(spUUID=None, options=None)
>Thread-26::DEBUG::2014-08-21 11:13:56,729::taskManager::181::TaskManager::(getAllTasksInfo) Entry.
>Thread-26::DEBUG::2014-08-21 11:13:56,730::taskManager::192::TaskManager::(getAllTasksInfo) Return. Response: {}
>Thread-26::INFO::2014-08-21 11:13:56,730::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksInfo, Return response: {'allTasksInfo': {}}
>Thread-26::DEBUG::2014-08-21 11:13:56,730::task::1185::TaskManager.Task::(prepare) Task=`6cb44417-94ae-4402-baa9-380b310de5c2`::finished: {'allTasksInfo': {}}
>Thread-26::DEBUG::2014-08-21 11:13:56,730::task::595::TaskManager.Task::(_updateState) Task=`6cb44417-94ae-4402-baa9-380b310de5c2`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:56,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:56,731::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:56,731::task::990::TaskManager.Task::(_decref) Task=`6cb44417-94ae-4402-baa9-380b310de5c2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:13:57,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:13:58,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0776567 s, 13.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:13:59,736::task::595::TaskManager.Task::(_updateState) Task=`819d2314-d714-4583-a506-a08bed9cf6ae`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:13:59,736::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:13:59,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00422161', 'lastCheck': '4.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:13:59,737::task::1185::TaskManager.Task::(prepare) Task=`819d2314-d714-4583-a506-a08bed9cf6ae`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00422161', 'lastCheck': '4.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:13:59,737::task::595::TaskManager.Task::(_updateState) Task=`819d2314-d714-4583-a506-a08bed9cf6ae`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:13:59,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:13:59,739::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:13:59,739::task::990::TaskManager.Task::(_decref) Task=`819d2314-d714-4583-a506-a08bed9cf6ae`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:14:00,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:14:00,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.163797 s, 6.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:14:02,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:14:02,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048035 s, 21.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:14:04,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:14:04,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444005 s, 23.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:14:05,520::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:14:05,537::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00387596 s, 128 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:17:06,559::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:17:06,706::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:17:06,748::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:17:06,785::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 11:17:06,791::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:17:06,792::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:17:06,792::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 11:17:06,842::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:17:06,883::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000414489 s, 1.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:17:07,033::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-26::DEBUG::2014-08-21 11:17:07,035::task::595::TaskManager.Task::(_updateState) Task=`c395db48-ffa9-4d76-a781-1be923c20556`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:17:07,035::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:17:07,036::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:17:07,036::task::1185::TaskManager.Task::(prepare) Task=`c395db48-ffa9-4d76-a781-1be923c20556`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:17:07,036::task::595::TaskManager.Task::(_updateState) Task=`c395db48-ffa9-4d76-a781-1be923c20556`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:17:07,037::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:17:07,037::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:17:07,037::task::990::TaskManager.Task::(_decref) Task=`c395db48-ffa9-4d76-a781-1be923c20556`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:17:07,045::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-34::DEBUG::2014-08-21 11:17:07,047::task::595::TaskManager.Task::(_updateState) Task=`03837d7a-c389-43ec-8e37-3044e450d761`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:17:07,048::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:17:07,050::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c0fde9f7-9b72-4912-a9e8-081c74c5da9d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:17:07,051::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:17:07,063::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:17:07,064::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c0fde9f7-9b72-4912-a9e8-081c74c5da9d`::Granted request
>Thread-34::DEBUG::2014-08-21 11:17:07,065::task::827::TaskManager.Task::(resourceAcquired) Task=`03837d7a-c389-43ec-8e37-3044e450d761`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:17:07,065::task::990::TaskManager.Task::(_decref) Task=`03837d7a-c389-43ec-8e37-3044e450d761`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:17:07,072::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:07,073::task::1185::TaskManager.Task::(prepare) Task=`03837d7a-c389-43ec-8e37-3044e450d761`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:07,074::task::595::TaskManager.Task::(_updateState) Task=`03837d7a-c389-43ec-8e37-3044e450d761`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:17:07,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:17:07,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:17:07,075::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:17:07,076::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:17:07,076::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:17:07,076::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:17:07,077::task::990::TaskManager.Task::(_decref) Task=`03837d7a-c389-43ec-8e37-3044e450d761`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:17:07,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:07,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103228 s, 9.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:09,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:09,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0532746 s, 19.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:11,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:11,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0513639 s, 19.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:13,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:14,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.420201 s, 2.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:17:15,219::task::595::TaskManager.Task::(_updateState) Task=`ad997142-82d9-4076-bcf0-ce4d550f3884`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:17:15,219::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:17:15,220::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414489', 'lastCheck': '8.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:17:15,220::task::1185::TaskManager.Task::(prepare) Task=`ad997142-82d9-4076-bcf0-ce4d550f3884`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414489', 'lastCheck': '8.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:17:15,220::task::595::TaskManager.Task::(_updateState) Task=`ad997142-82d9-4076-bcf0-ce4d550f3884`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:17:15,221::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:17:15,221::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:17:15,221::task::990::TaskManager.Task::(_decref) Task=`ad997142-82d9-4076-bcf0-ce4d550f3884`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:17:16,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:16,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0713336 s, 14.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:17:16,911::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:17:16,948::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000911338 s, 546 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:17:17,111::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-26::DEBUG::2014-08-21 11:17:17,112::task::595::TaskManager.Task::(_updateState) Task=`2672205a-faac-4f99-8663-22d5dcd18979`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:17:17,112::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:17:17,113::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:17:17,113::task::1185::TaskManager.Task::(prepare) Task=`2672205a-faac-4f99-8663-22d5dcd18979`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:17:17,113::task::595::TaskManager.Task::(_updateState) Task=`2672205a-faac-4f99-8663-22d5dcd18979`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:17:17,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:17:17,114::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:17:17,114::task::990::TaskManager.Task::(_decref) Task=`2672205a-faac-4f99-8663-22d5dcd18979`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:17:17,118::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-34::DEBUG::2014-08-21 11:17:17,119::task::595::TaskManager.Task::(_updateState) Task=`e15b8d89-3b2c-4371-9c24-2841fcec3e7a`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:17:17,119::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:17:17,120::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`def7602f-a680-4c7b-9450-08f0436339e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:17:17,120::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:17:17,120::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:17:17,121::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`def7602f-a680-4c7b-9450-08f0436339e0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:17:17,121::task::827::TaskManager.Task::(resourceAcquired) Task=`e15b8d89-3b2c-4371-9c24-2841fcec3e7a`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:17:17,121::task::990::TaskManager.Task::(_decref) Task=`e15b8d89-3b2c-4371-9c24-2841fcec3e7a`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:17:17,125::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:17,126::task::1185::TaskManager.Task::(prepare) Task=`e15b8d89-3b2c-4371-9c24-2841fcec3e7a`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:17,126::task::595::TaskManager.Task::(_updateState) Task=`e15b8d89-3b2c-4371-9c24-2841fcec3e7a`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:17:17,126::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:17:17,126::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:17:17,127::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:17:17,127::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:17:17,127::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:17:17,127::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:17:17,128::task::990::TaskManager.Task::(_decref) Task=`e15b8d89-3b2c-4371-9c24-2841fcec3e7a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:17:18,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:18,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0518987 s, 19.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:21,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:23,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.28723 s, 796 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:25,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:25,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0677259 s, 15.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:28,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:17:28,346::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-26::DEBUG::2014-08-21 11:17:28,348::task::595::TaskManager.Task::(_updateState) Task=`4c7579e0-5761-4161-bd67-b8197f7f0c41`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:17:28,348::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:17:28,349::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:17:28,703::task::1185::TaskManager.Task::(prepare) Task=`4c7579e0-5761-4161-bd67-b8197f7f0c41`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:17:28,704::task::595::TaskManager.Task::(_updateState) Task=`4c7579e0-5761-4161-bd67-b8197f7f0c41`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:17:29,247::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:17:29,248::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:17:29,249::task::990::TaskManager.Task::(_decref) Task=`4c7579e0-5761-4161-bd67-b8197f7f0c41`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:17:29,251::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:17:29,619::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 11:17:29,654::task::595::TaskManager.Task::(_updateState) Task=`2a07aa7a-ac6d-4c4a-9737-625c03610bec`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:17:29,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:17:29,670::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bed8ab89-59c1-4bb0-8166-ab2eb0b8da7f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:17:29,671::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:17:29,672::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:17:29,673::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bed8ab89-59c1-4bb0-8166-ab2eb0b8da7f`::Granted request
>Thread-34::DEBUG::2014-08-21 11:17:29,818::task::827::TaskManager.Task::(resourceAcquired) Task=`2a07aa7a-ac6d-4c4a-9737-625c03610bec`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:17:29,819::task::990::TaskManager.Task::(_decref) Task=`2a07aa7a-ac6d-4c4a-9737-625c03610bec`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:17:30,446::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:30,455::task::1185::TaskManager.Task::(prepare) Task=`2a07aa7a-ac6d-4c4a-9737-625c03610bec`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:30,633::task::595::TaskManager.Task::(_updateState) Task=`2a07aa7a-ac6d-4c4a-9737-625c03610bec`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:17:30,634::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:17:30,634::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:17:30,711::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:17:30,711::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:17:30,712::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:17:30,724::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:17:30,740::task::990::TaskManager.Task::(_decref) Task=`2a07aa7a-ac6d-4c4a-9737-625c03610bec`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:17:30,785::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.03628 s, 13.7 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:17:32,179::task::595::TaskManager.Task::(_updateState) Task=`98b7d13a-dee7-4a91-bd94-baede9c1bbae`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:17:32,179::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:17:32,179::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.03628', 'lastCheck': '1.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:17:32,199::task::1185::TaskManager.Task::(prepare) Task=`98b7d13a-dee7-4a91-bd94-baede9c1bbae`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.03628', 'lastCheck': '1.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:17:32,200::task::595::TaskManager.Task::(_updateState) Task=`98b7d13a-dee7-4a91-bd94-baede9c1bbae`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:17:32,200::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:17:32,201::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:17:32,201::task::990::TaskManager.Task::(_decref) Task=`98b7d13a-dee7-4a91-bd94-baede9c1bbae`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:17:35,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.5363 s, 226 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:40,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:17:41,916::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-13::DEBUG::2014-08-21 11:17:41,922::task::595::TaskManager.Task::(_updateState) Task=`5f9297b0-270c-4cef-94bb-f4a83db1dc51`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:17:41,923::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:17:41,932::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:17:41,934::task::1185::TaskManager.Task::(prepare) Task=`5f9297b0-270c-4cef-94bb-f4a83db1dc51`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:17:41,935::task::595::TaskManager.Task::(_updateState) Task=`5f9297b0-270c-4cef-94bb-f4a83db1dc51`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:17:41,938::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:17:41,939::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:17:41,940::task::990::TaskManager.Task::(_decref) Task=`5f9297b0-270c-4cef-94bb-f4a83db1dc51`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:17:41,947::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-34::DEBUG::2014-08-21 11:17:41,951::task::595::TaskManager.Task::(_updateState) Task=`9dce4b21-f547-4b65-8ffb-2aa13cbd899b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:17:41,951::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:17:41,954::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c306fec9-079c-45d1-baa1-6514c0bda6e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:17:41,954::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:17:41,966::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:17:41,966::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c306fec9-079c-45d1-baa1-6514c0bda6e8`::Granted request
>Thread-34::DEBUG::2014-08-21 11:17:41,967::task::827::TaskManager.Task::(resourceAcquired) Task=`9dce4b21-f547-4b65-8ffb-2aa13cbd899b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:17:41,967::task::990::TaskManager.Task::(_decref) Task=`9dce4b21-f547-4b65-8ffb-2aa13cbd899b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:17:41,972::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:41,972::task::1185::TaskManager.Task::(prepare) Task=`9dce4b21-f547-4b65-8ffb-2aa13cbd899b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:41,972::task::595::TaskManager.Task::(_updateState) Task=`9dce4b21-f547-4b65-8ffb-2aa13cbd899b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:17:41,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:17:41,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:17:41,973::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:17:41,974::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:17:41,974::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:17:41,974::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:17:41,975::task::990::TaskManager.Task::(_decref) Task=`9dce4b21-f547-4b65-8ffb-2aa13cbd899b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:17:42,009::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:17:42,053::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000852646 s, 584 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:42,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.05736 s, 498 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:44,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:44,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0664912 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:46,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:46,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.291959 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:48,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:49,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.289482 s, 3.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:17:50,633::task::595::TaskManager.Task::(_updateState) Task=`bee8755b-55fc-453c-969e-b5de7e00ec8d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:17:50,633::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:17:50,634::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000852646', 'lastCheck': '8.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:17:50,634::task::1185::TaskManager.Task::(prepare) Task=`bee8755b-55fc-453c-969e-b5de7e00ec8d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000852646', 'lastCheck': '8.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:17:50,634::task::595::TaskManager.Task::(_updateState) Task=`bee8755b-55fc-453c-969e-b5de7e00ec8d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:17:50,634::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:17:50,635::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:17:50,635::task::990::TaskManager.Task::(_decref) Task=`bee8755b-55fc-453c-969e-b5de7e00ec8d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:17:51,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:51,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0671146 s, 15.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:17:52,008::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-13::DEBUG::2014-08-21 11:17:52,009::task::595::TaskManager.Task::(_updateState) Task=`225b24db-37f9-4579-b6de-184a89ce3e88`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:17:52,009::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:17:52,010::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:17:52,010::task::1185::TaskManager.Task::(prepare) Task=`225b24db-37f9-4579-b6de-184a89ce3e88`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:17:52,011::task::595::TaskManager.Task::(_updateState) Task=`225b24db-37f9-4579-b6de-184a89ce3e88`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:17:52,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:17:52,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:17:52,011::task::990::TaskManager.Task::(_decref) Task=`225b24db-37f9-4579-b6de-184a89ce3e88`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:17:52,016::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-34::DEBUG::2014-08-21 11:17:52,017::task::595::TaskManager.Task::(_updateState) Task=`98dcd8f8-a596-4885-a192-caa8e93f4bc0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:17:52,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:17:52,018::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1fe4b677-2773-40b8-8f68-5f0220766da8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:17:52,018::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:17:52,018::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:17:52,019::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1fe4b677-2773-40b8-8f68-5f0220766da8`::Granted request
>Thread-34::DEBUG::2014-08-21 11:17:52,019::task::827::TaskManager.Task::(resourceAcquired) Task=`98dcd8f8-a596-4885-a192-caa8e93f4bc0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:17:52,019::task::990::TaskManager.Task::(_decref) Task=`98dcd8f8-a596-4885-a192-caa8e93f4bc0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:17:52,023::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:52,023::task::1185::TaskManager.Task::(prepare) Task=`98dcd8f8-a596-4885-a192-caa8e93f4bc0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:17:52,023::task::595::TaskManager.Task::(_updateState) Task=`98dcd8f8-a596-4885-a192-caa8e93f4bc0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:17:52,023::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:17:52,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:17:52,024::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:17:52,024::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:17:52,024::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:17:52,024::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:17:52,025::task::990::TaskManager.Task::(_decref) Task=`98dcd8f8-a596-4885-a192-caa8e93f4bc0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:17:52,099::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:17:52,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000550368 s, 905 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:53,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:53,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0513471 s, 19.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:55,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:55,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492802 s, 20.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:57,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:17:57,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.186335 s, 5.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:17:59,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:00,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.113302 s, 9.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:18:02,040::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-13::DEBUG::2014-08-21 11:18:02,042::task::595::TaskManager.Task::(_updateState) Task=`728d5fc3-b1fa-419c-b5b4-bc499c469cba`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:18:02,042::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:18:02,043::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:18:02,043::task::1185::TaskManager.Task::(prepare) Task=`728d5fc3-b1fa-419c-b5b4-bc499c469cba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:18:02,043::task::595::TaskManager.Task::(_updateState) Task=`728d5fc3-b1fa-419c-b5b4-bc499c469cba`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:18:02,044::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:18:02,044::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:18:02,044::task::990::TaskManager.Task::(_decref) Task=`728d5fc3-b1fa-419c-b5b4-bc499c469cba`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:18:02,048::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-34::DEBUG::2014-08-21 11:18:02,048::task::595::TaskManager.Task::(_updateState) Task=`b7c64900-3575-4c40-9f84-72e415b25415`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:18:02,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:18:02,049::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b5eb5df5-7f87-4306-80f2-4c52e42ad2e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:18:02,049::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:18:02,050::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:18:02,050::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b5eb5df5-7f87-4306-80f2-4c52e42ad2e1`::Granted request
>Thread-34::DEBUG::2014-08-21 11:18:02,050::task::827::TaskManager.Task::(resourceAcquired) Task=`b7c64900-3575-4c40-9f84-72e415b25415`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:18:02,050::task::990::TaskManager.Task::(_decref) Task=`b7c64900-3575-4c40-9f84-72e415b25415`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:18:02,054::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:02,054::task::1185::TaskManager.Task::(prepare) Task=`b7c64900-3575-4c40-9f84-72e415b25415`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:02,054::task::595::TaskManager.Task::(_updateState) Task=`b7c64900-3575-4c40-9f84-72e415b25415`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:18:02,054::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:18:02,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:18:02,055::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:18:02,055::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:18:02,055::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:18:02,055::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:18:02,055::task::990::TaskManager.Task::(_decref) Task=`b7c64900-3575-4c40-9f84-72e415b25415`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:18:02,144::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:18:02,166::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00166881 s, 298 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:02,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:02,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0955312 s, 10.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:04,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:04,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406892 s, 25.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:18:06,360::task::595::TaskManager.Task::(_updateState) Task=`9a0f9287-47b4-4efb-81e9-1eb231eb2b1e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:18:06,360::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:18:06,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00166881', 'lastCheck': '4.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:18:06,361::task::1185::TaskManager.Task::(prepare) Task=`9a0f9287-47b4-4efb-81e9-1eb231eb2b1e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00166881', 'lastCheck': '4.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:18:06,361::task::595::TaskManager.Task::(_updateState) Task=`9a0f9287-47b4-4efb-81e9-1eb231eb2b1e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:18:06,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:18:06,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:18:06,362::task::990::TaskManager.Task::(_decref) Task=`9a0f9287-47b4-4efb-81e9-1eb231eb2b1e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:18:06,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:07,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.477973 s, 2.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:09,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:09,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0555423 s, 18.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:11,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:18:12,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-13::DEBUG::2014-08-21 11:18:12,570::task::595::TaskManager.Task::(_updateState) Task=`c26f12f4-391b-45ea-8580-9ed19b2dc14d`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 11:18:12,595::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::INFO::2014-08-21 11:18:12,614::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:18:12,647::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:18:12,648::task::1185::TaskManager.Task::(prepare) Task=`c26f12f4-391b-45ea-8580-9ed19b2dc14d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:18:12,652::task::595::TaskManager.Task::(_updateState) Task=`c26f12f4-391b-45ea-8580-9ed19b2dc14d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:18:12,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:18:12,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:18:12,654::task::990::TaskManager.Task::(_decref) Task=`c26f12f4-391b-45ea-8580-9ed19b2dc14d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:18:12,668::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-34::DEBUG::2014-08-21 11:18:12,669::task::595::TaskManager.Task::(_updateState) Task=`df05a4bf-f83a-492e-8c00-beb2823cac9f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:18:12,670::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:18:12,672::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cc36e22d-561f-40b4-8e8d-e1e779cea9b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:18:12,672::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:18:12,673::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:18:12,674::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cc36e22d-561f-40b4-8e8d-e1e779cea9b7`::Granted request
>Thread-34::DEBUG::2014-08-21 11:18:12,674::task::827::TaskManager.Task::(resourceAcquired) Task=`df05a4bf-f83a-492e-8c00-beb2823cac9f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:18:12,676::task::990::TaskManager.Task::(_decref) Task=`df05a4bf-f83a-492e-8c00-beb2823cac9f`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:18:12,682::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00127413 s, 391 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:18:12,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:12,697::task::1185::TaskManager.Task::(prepare) Task=`df05a4bf-f83a-492e-8c00-beb2823cac9f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:12,704::task::595::TaskManager.Task::(_updateState) Task=`df05a4bf-f83a-492e-8c00-beb2823cac9f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:18:12,705::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:18:12,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:18:12,710::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:18:12,711::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:18:12,712::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:18:12,713::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:18:12,715::task::990::TaskManager.Task::(_decref) Task=`df05a4bf-f83a-492e-8c00-beb2823cac9f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:18:12,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.2888 s, 795 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:14,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:14,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0707727 s, 14.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:16,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:17,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.176076 s, 5.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:19,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:21,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.740255 s, 1.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:18:22,744::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:18:22,949::task::595::TaskManager.Task::(_updateState) Task=`b3fdd97b-8afe-4ba1-8160-ee1fbe2a0e17`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:18:22,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-15::DEBUG::2014-08-21 11:18:22,900::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00895736 s, 55.6 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:18:23,172::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2968f8dd]
>Thread-26::INFO::2014-08-21 11:18:23,258::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00127413', 'lastCheck': '10.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:18:23,266::task::1185::TaskManager.Task::(prepare) Task=`b3fdd97b-8afe-4ba1-8160-ee1fbe2a0e17`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00127413', 'lastCheck': '10.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:18:23,268::task::595::TaskManager.Task::(_updateState) Task=`b3fdd97b-8afe-4ba1-8160-ee1fbe2a0e17`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:18:23,276::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:18:23,287::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:18:23,322::task::990::TaskManager.Task::(_decref) Task=`b3fdd97b-8afe-4ba1-8160-ee1fbe2a0e17`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:18:24,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:18:25,339::task::595::TaskManager.Task::(_updateState) Task=`d65428de-a910-4779-aca6-75331f56f1b5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:18:25,340::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:18:25,341::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:18:25,341::task::1185::TaskManager.Task::(prepare) Task=`d65428de-a910-4779-aca6-75331f56f1b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:18:25,342::task::595::TaskManager.Task::(_updateState) Task=`d65428de-a910-4779-aca6-75331f56f1b5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:18:25,342::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:18:25,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:18:25,381::task::990::TaskManager.Task::(_decref) Task=`d65428de-a910-4779-aca6-75331f56f1b5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:18:25,652::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2968f8dd]
>Thread-34::DEBUG::2014-08-21 11:18:25,653::task::595::TaskManager.Task::(_updateState) Task=`ef1aa504-68ab-431b-ac3b-9742d446d15d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:18:25,653::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:18:25,654::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c1b5666b-6017-4a1a-9cfd-eb8a983010e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:18:25,655::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:18:25,655::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:18:25,655::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c1b5666b-6017-4a1a-9cfd-eb8a983010e2`::Granted request
>Thread-34::DEBUG::2014-08-21 11:18:25,670::task::827::TaskManager.Task::(resourceAcquired) Task=`ef1aa504-68ab-431b-ac3b-9742d446d15d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:18:25,670::task::990::TaskManager.Task::(_decref) Task=`ef1aa504-68ab-431b-ac3b-9742d446d15d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:18:25,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:25,677::task::1185::TaskManager.Task::(prepare) Task=`ef1aa504-68ab-431b-ac3b-9742d446d15d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:25,677::task::595::TaskManager.Task::(_updateState) Task=`ef1aa504-68ab-431b-ac3b-9742d446d15d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:18:25,677::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:18:25,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:18:25,678::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:18:25,680::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:18:25,686::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:18:25,686::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:18:25,687::task::990::TaskManager.Task::(_decref) Task=`ef1aa504-68ab-431b-ac3b-9742d446d15d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:18:25,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.590646 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:27,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:28,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.122927 s, 8.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:30,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:30,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.658774 s, 1.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:33,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:33,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460176 s, 22.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:35,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:35,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046553 s, 22.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:18:35,292::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:18:35,306::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00147678 s, 337 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:18:35,755::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-26::DEBUG::2014-08-21 11:18:35,756::task::595::TaskManager.Task::(_updateState) Task=`14b86dfb-d29f-4a8b-98e8-2ad283486cbe`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:18:35,757::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:18:35,763::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:18:35,763::task::1185::TaskManager.Task::(prepare) Task=`14b86dfb-d29f-4a8b-98e8-2ad283486cbe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:18:35,800::task::595::TaskManager.Task::(_updateState) Task=`14b86dfb-d29f-4a8b-98e8-2ad283486cbe`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:18:35,827::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:18:35,875::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:18:37,051::task::990::TaskManager.Task::(_decref) Task=`14b86dfb-d29f-4a8b-98e8-2ad283486cbe`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:18:37,058::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-34::DEBUG::2014-08-21 11:18:37,067::task::595::TaskManager.Task::(_updateState) Task=`92cc2561-40f5-47e8-b8f0-7b9591a078c6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:18:37,067::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:18:37,068::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`015f6972-17c2-43e8-8773-0a39d42267c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:18:37,069::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:18:37,069::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:18:37,070::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`015f6972-17c2-43e8-8773-0a39d42267c3`::Granted request
>Thread-34::DEBUG::2014-08-21 11:18:37,070::task::827::TaskManager.Task::(resourceAcquired) Task=`92cc2561-40f5-47e8-b8f0-7b9591a078c6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:18:37,071::task::990::TaskManager.Task::(_decref) Task=`92cc2561-40f5-47e8-b8f0-7b9591a078c6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:18:37,077::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894753280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:37,077::task::1185::TaskManager.Task::(prepare) Task=`92cc2561-40f5-47e8-b8f0-7b9591a078c6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894753280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:37,077::task::595::TaskManager.Task::(_updateState) Task=`92cc2561-40f5-47e8-b8f0-7b9591a078c6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:18:37,078::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:18:37,078::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:18:37,079::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:18:37,079::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:18:37,079::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:18:37,080::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:18:37,080::task::990::TaskManager.Task::(_decref) Task=`92cc2561-40f5-47e8-b8f0-7b9591a078c6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:18:37,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:38,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.422589 s, 2.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:40,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:40,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.245651 s, 4.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:18:41,359::task::595::TaskManager.Task::(_updateState) Task=`2e1a2055-f651-4f06-a313-a3d3957a5600`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:18:41,360::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:18:41,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00147678', 'lastCheck': '6.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:18:41,361::task::1185::TaskManager.Task::(prepare) Task=`2e1a2055-f651-4f06-a313-a3d3957a5600`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00147678', 'lastCheck': '6.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:18:41,361::task::595::TaskManager.Task::(_updateState) Task=`2e1a2055-f651-4f06-a313-a3d3957a5600`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:18:41,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:18:41,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:18:41,362::task::990::TaskManager.Task::(_decref) Task=`2e1a2055-f651-4f06-a313-a3d3957a5600`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:18:43,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:44,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.804283 s, 1.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:18:45,333::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:18:45,347::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000548928 s, 907 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:46,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:46,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.151929 s, 6.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:18:47,097::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-26::DEBUG::2014-08-21 11:18:47,098::task::595::TaskManager.Task::(_updateState) Task=`9121474f-2a59-481a-9f79-93bb5ce447d0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:18:47,098::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:18:47,099::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:18:47,099::task::1185::TaskManager.Task::(prepare) Task=`9121474f-2a59-481a-9f79-93bb5ce447d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:18:47,099::task::595::TaskManager.Task::(_updateState) Task=`9121474f-2a59-481a-9f79-93bb5ce447d0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:18:47,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:18:47,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:18:47,100::task::990::TaskManager.Task::(_decref) Task=`9121474f-2a59-481a-9f79-93bb5ce447d0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:18:47,105::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 11:18:47,105::task::595::TaskManager.Task::(_updateState) Task=`c1d2373e-dd61-4dc2-a58a-3b4195fbb02b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:18:47,105::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:18:47,106::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0e71239e-0f2d-4cc6-a23b-d00fcd752ba5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:18:47,107::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:18:47,107::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:18:47,107::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0e71239e-0f2d-4cc6-a23b-d00fcd752ba5`::Granted request
>Thread-34::DEBUG::2014-08-21 11:18:47,108::task::827::TaskManager.Task::(resourceAcquired) Task=`c1d2373e-dd61-4dc2-a58a-3b4195fbb02b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:18:47,108::task::990::TaskManager.Task::(_decref) Task=`c1d2373e-dd61-4dc2-a58a-3b4195fbb02b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:18:47,112::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:47,112::task::1185::TaskManager.Task::(prepare) Task=`c1d2373e-dd61-4dc2-a58a-3b4195fbb02b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:47,113::task::595::TaskManager.Task::(_updateState) Task=`c1d2373e-dd61-4dc2-a58a-3b4195fbb02b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:18:47,113::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:18:47,113::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:18:47,114::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:18:47,114::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:18:47,114::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:18:47,115::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:18:47,115::task::990::TaskManager.Task::(_decref) Task=`c1d2373e-dd61-4dc2-a58a-3b4195fbb02b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:18:48,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:49,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.44663 s, 708 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:52,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:52,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.354966 s, 2.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:54,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:55,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.206152 s, 5.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:18:55,474::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:18:55,501::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0117065 s, 42.5 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:18:56,696::task::595::TaskManager.Task::(_updateState) Task=`247a7bb0-7993-4552-984a-9c6594d23b8b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:18:56,697::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:18:56,697::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117065', 'lastCheck': '1.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:18:56,697::task::1185::TaskManager.Task::(prepare) Task=`247a7bb0-7993-4552-984a-9c6594d23b8b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117065', 'lastCheck': '1.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:18:56,698::task::595::TaskManager.Task::(_updateState) Task=`247a7bb0-7993-4552-984a-9c6594d23b8b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:18:56,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:18:56,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:18:56,698::task::990::TaskManager.Task::(_decref) Task=`247a7bb0-7993-4552-984a-9c6594d23b8b`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:18:57,138::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-26::DEBUG::2014-08-21 11:18:57,139::task::595::TaskManager.Task::(_updateState) Task=`7922d55b-7b08-479b-aa30-758b90458316`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:18:57,140::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:18:57,140::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:18:57,141::task::1185::TaskManager.Task::(prepare) Task=`7922d55b-7b08-479b-aa30-758b90458316`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:18:57,141::task::595::TaskManager.Task::(_updateState) Task=`7922d55b-7b08-479b-aa30-758b90458316`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:18:57,141::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:18:57,142::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:18:57,142::task::990::TaskManager.Task::(_decref) Task=`7922d55b-7b08-479b-aa30-758b90458316`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:18:57,147::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 11:18:57,148::task::595::TaskManager.Task::(_updateState) Task=`e87635fc-b85e-4cff-a66c-7e05c7ce8475`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:18:57,148::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:18:57,149::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f99ac7a3-493f-4c98-a0bf-3e6975b8a5c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:18:57,149::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:18:57,150::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:18:57,150::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f99ac7a3-493f-4c98-a0bf-3e6975b8a5c5`::Granted request
>Thread-34::DEBUG::2014-08-21 11:18:57,150::task::827::TaskManager.Task::(resourceAcquired) Task=`e87635fc-b85e-4cff-a66c-7e05c7ce8475`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:18:57,150::task::990::TaskManager.Task::(_decref) Task=`e87635fc-b85e-4cff-a66c-7e05c7ce8475`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:18:57,154::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894687744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:57,154::task::1185::TaskManager.Task::(prepare) Task=`e87635fc-b85e-4cff-a66c-7e05c7ce8475`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894687744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:18:57,155::task::595::TaskManager.Task::(_updateState) Task=`e87635fc-b85e-4cff-a66c-7e05c7ce8475`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:18:57,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:18:57,155::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:18:57,155::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:18:57,156::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:18:57,156::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:18:57,156::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:18:57,156::task::990::TaskManager.Task::(_decref) Task=`e87635fc-b85e-4cff-a66c-7e05c7ce8475`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:18:57,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:57,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439189 s, 23.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:18:59,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:18:59,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041826 s, 24.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:01,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:01,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0686101 s, 14.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:03,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:04,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0803109 s, 12.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:19:05,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:19:05,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000618641 s, 805 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:06,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:06,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0563312 s, 18.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:19:07,174::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [727d0c40]
>Thread-26::DEBUG::2014-08-21 11:19:07,176::task::595::TaskManager.Task::(_updateState) Task=`507ad5da-c2c5-4452-a585-5976fc21d3ac`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:19:07,177::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:19:07,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:07,178::task::1185::TaskManager.Task::(prepare) Task=`507ad5da-c2c5-4452-a585-5976fc21d3ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:07,178::task::595::TaskManager.Task::(_updateState) Task=`507ad5da-c2c5-4452-a585-5976fc21d3ac`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:19:07,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:19:07,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:19:07,180::task::990::TaskManager.Task::(_decref) Task=`507ad5da-c2c5-4452-a585-5976fc21d3ac`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:19:07,190::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [727d0c40]
>Thread-34::DEBUG::2014-08-21 11:19:07,191::task::595::TaskManager.Task::(_updateState) Task=`0647923f-e898-4e18-a40e-ee03f0bfe09b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:19:07,192::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:19:07,193::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c3b0d2b5-f72f-40a8-821f-e0e1b6a8e746`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:19:07,193::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:19:07,194::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:19:07,194::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c3b0d2b5-f72f-40a8-821f-e0e1b6a8e746`::Granted request
>Thread-34::DEBUG::2014-08-21 11:19:07,195::task::827::TaskManager.Task::(resourceAcquired) Task=`0647923f-e898-4e18-a40e-ee03f0bfe09b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:19:07,196::task::990::TaskManager.Task::(_decref) Task=`0647923f-e898-4e18-a40e-ee03f0bfe09b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:19:07,205::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:07,205::task::1185::TaskManager.Task::(prepare) Task=`0647923f-e898-4e18-a40e-ee03f0bfe09b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:07,206::task::595::TaskManager.Task::(_updateState) Task=`0647923f-e898-4e18-a40e-ee03f0bfe09b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:19:07,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:19:07,207::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:19:07,207::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:19:07,209::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:19:07,209::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:19:07,209::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:19:07,210::task::990::TaskManager.Task::(_decref) Task=`0647923f-e898-4e18-a40e-ee03f0bfe09b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:19:08,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:08,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0568374 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:10,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:10,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08689 s, 11.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:19:12,100::task::595::TaskManager.Task::(_updateState) Task=`0e82824c-67eb-4c16-abef-6fcb55d3d275`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:19:12,101::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:19:12,101::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618641', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:19:12,101::task::1185::TaskManager.Task::(prepare) Task=`0e82824c-67eb-4c16-abef-6fcb55d3d275`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618641', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:19:12,101::task::595::TaskManager.Task::(_updateState) Task=`0e82824c-67eb-4c16-abef-6fcb55d3d275`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:19:12,102::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:19:12,102::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:19:12,102::task::990::TaskManager.Task::(_decref) Task=`0e82824c-67eb-4c16-abef-6fcb55d3d275`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:19:12,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:12,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461035 s, 22.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:15,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:19:15,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:19:15,668::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00123923 s, 402 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:15,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.544526 s, 1.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:19:17,231::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-26::DEBUG::2014-08-21 11:19:17,232::task::595::TaskManager.Task::(_updateState) Task=`915a3530-bd66-4ef0-bd73-e5131b7a410f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:19:17,232::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:19:17,233::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:17,233::task::1185::TaskManager.Task::(prepare) Task=`915a3530-bd66-4ef0-bd73-e5131b7a410f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:17,233::task::595::TaskManager.Task::(_updateState) Task=`915a3530-bd66-4ef0-bd73-e5131b7a410f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:19:17,234::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:19:17,234::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:19:17,234::task::990::TaskManager.Task::(_decref) Task=`915a3530-bd66-4ef0-bd73-e5131b7a410f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:19:17,238::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 11:19:17,238::task::595::TaskManager.Task::(_updateState) Task=`9ee9fc49-0cd9-4e45-9115-3ec990bcc098`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:19:17,239::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:19:17,239::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`56ec1505-0236-4f4f-b988-e1e58b71f5a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:19:17,239::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:19:17,240::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:19:17,240::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`56ec1505-0236-4f4f-b988-e1e58b71f5a5`::Granted request
>Thread-34::DEBUG::2014-08-21 11:19:17,240::task::827::TaskManager.Task::(resourceAcquired) Task=`9ee9fc49-0cd9-4e45-9115-3ec990bcc098`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:19:17,241::task::990::TaskManager.Task::(_decref) Task=`9ee9fc49-0cd9-4e45-9115-3ec990bcc098`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:19:17,244::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:17,244::task::1185::TaskManager.Task::(prepare) Task=`9ee9fc49-0cd9-4e45-9115-3ec990bcc098`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:17,244::task::595::TaskManager.Task::(_updateState) Task=`9ee9fc49-0cd9-4e45-9115-3ec990bcc098`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:19:17,245::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:19:17,245::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:19:17,245::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:19:17,245::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:19:17,245::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:19:17,246::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:19:17,246::task::990::TaskManager.Task::(_decref) Task=`9ee9fc49-0cd9-4e45-9115-3ec990bcc098`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:19:17,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:17,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0648653 s, 15.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:19,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:20,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457964 s, 22.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:22,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:22,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.17092 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:24,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:24,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0724061 s, 14.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:19:25,708::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:19:25,735::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000787357 s, 632 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:26,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:19:27,843::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-26::DEBUG::2014-08-21 11:19:27,861::task::595::TaskManager.Task::(_updateState) Task=`ab06fa38-cbab-4e7d-b026-b8dc9d586b2c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:19:27,863::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:19:27,864::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:27,865::task::1185::TaskManager.Task::(prepare) Task=`ab06fa38-cbab-4e7d-b026-b8dc9d586b2c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:27,866::task::595::TaskManager.Task::(_updateState) Task=`ab06fa38-cbab-4e7d-b026-b8dc9d586b2c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:19:27,866::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:19:27,867::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:19:27,867::task::990::TaskManager.Task::(_decref) Task=`ab06fa38-cbab-4e7d-b026-b8dc9d586b2c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:19:27,907::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-34::DEBUG::2014-08-21 11:19:27,912::task::595::TaskManager.Task::(_updateState) Task=`33eaf443-4d4b-43b0-a8bf-0510724b8ad2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:19:27,915::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:19:27,923::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ca924f82-c349-4edf-8585-3f659401a812`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:19:27,925::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:19:27,927::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:19:27,929::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ca924f82-c349-4edf-8585-3f659401a812`::Granted request
>Thread-34::DEBUG::2014-08-21 11:19:27,932::task::827::TaskManager.Task::(resourceAcquired) Task=`33eaf443-4d4b-43b0-a8bf-0510724b8ad2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:19:27,933::task::990::TaskManager.Task::(_decref) Task=`33eaf443-4d4b-43b0-a8bf-0510724b8ad2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:19:27,954::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:27,955::task::1185::TaskManager.Task::(prepare) Task=`33eaf443-4d4b-43b0-a8bf-0510724b8ad2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:27,956::task::595::TaskManager.Task::(_updateState) Task=`33eaf443-4d4b-43b0-a8bf-0510724b8ad2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:19:27,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:19:27,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:19:27,959::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:19:27,960::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:19:27,961::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:19:27,962::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:19:27,964::task::990::TaskManager.Task::(_decref) Task=`33eaf443-4d4b-43b0-a8bf-0510724b8ad2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:19:28,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.940299 s, 1.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:19:28,339::task::595::TaskManager.Task::(_updateState) Task=`e897b412-16b2-4915-802a-e6973684a1b8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:19:28,340::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:19:28,340::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787357', 'lastCheck': '2.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:19:28,341::task::1185::TaskManager.Task::(prepare) Task=`e897b412-16b2-4915-802a-e6973684a1b8`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787357', 'lastCheck': '2.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:19:28,341::task::595::TaskManager.Task::(_updateState) Task=`e897b412-16b2-4915-802a-e6973684a1b8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:19:28,341::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:19:28,342::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:19:28,342::task::990::TaskManager.Task::(_decref) Task=`e897b412-16b2-4915-802a-e6973684a1b8`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:19:30,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:30,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0663797 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:32,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:32,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100865 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:34,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:35,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.721564 s, 1.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:19:36,172::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:19:36,227::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00150186 s, 332 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:19:37,983::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-26::DEBUG::2014-08-21 11:19:37,985::task::595::TaskManager.Task::(_updateState) Task=`f117a6fb-86eb-4b3d-9828-c6b226bf3e4b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:19:37,985::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:19:37,985::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:37,986::task::1185::TaskManager.Task::(prepare) Task=`f117a6fb-86eb-4b3d-9828-c6b226bf3e4b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:37,986::task::595::TaskManager.Task::(_updateState) Task=`f117a6fb-86eb-4b3d-9828-c6b226bf3e4b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:19:37,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:19:37,986::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:19:37,987::task::990::TaskManager.Task::(_decref) Task=`f117a6fb-86eb-4b3d-9828-c6b226bf3e4b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:19:37,991::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-34::DEBUG::2014-08-21 11:19:37,992::task::595::TaskManager.Task::(_updateState) Task=`161a3c1c-ee39-44b9-8e2c-bec5b764e41d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:19:37,992::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:19:37,992::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b9151fbe-3ea9-471a-ae91-a177300ffdc2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:19:37,993::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:19:37,993::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:19:37,993::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b9151fbe-3ea9-471a-ae91-a177300ffdc2`::Granted request
>Thread-34::DEBUG::2014-08-21 11:19:37,993::task::827::TaskManager.Task::(resourceAcquired) Task=`161a3c1c-ee39-44b9-8e2c-bec5b764e41d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:19:37,994::task::990::TaskManager.Task::(_decref) Task=`161a3c1c-ee39-44b9-8e2c-bec5b764e41d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:19:37,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:37,997::task::1185::TaskManager.Task::(prepare) Task=`161a3c1c-ee39-44b9-8e2c-bec5b764e41d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:37,997::task::595::TaskManager.Task::(_updateState) Task=`161a3c1c-ee39-44b9-8e2c-bec5b764e41d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:19:37,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:19:37,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:19:37,998::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:19:37,998::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:19:37,998::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:19:37,998::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:19:37,999::task::990::TaskManager.Task::(_decref) Task=`161a3c1c-ee39-44b9-8e2c-bec5b764e41d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:19:38,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:38,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0644845 s, 15.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:41,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:42,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.69577 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:44,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:44,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.099055 s, 10.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:19:45,244::task::595::TaskManager.Task::(_updateState) Task=`7b9f4d7e-5428-4b86-afbd-c91e8e0550f8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:19:45,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:19:45,245::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150186', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:19:45,245::task::1185::TaskManager.Task::(prepare) Task=`7b9f4d7e-5428-4b86-afbd-c91e8e0550f8`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150186', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:19:45,245::task::595::TaskManager.Task::(_updateState) Task=`7b9f4d7e-5428-4b86-afbd-c91e8e0550f8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:19:45,245::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:19:45,246::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:19:45,246::task::990::TaskManager.Task::(_decref) Task=`7b9f4d7e-5428-4b86-afbd-c91e8e0550f8`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:19:46,263::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:19:46,283::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000492522 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:46,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:19:48,660::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-26::DEBUG::2014-08-21 11:19:48,662::task::595::TaskManager.Task::(_updateState) Task=`2a7b23d3-ebf6-48bb-9dd8-dd82ad3c78eb`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:19:48,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:19:48,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:48,664::task::1185::TaskManager.Task::(prepare) Task=`2a7b23d3-ebf6-48bb-9dd8-dd82ad3c78eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:19:48,664::task::595::TaskManager.Task::(_updateState) Task=`2a7b23d3-ebf6-48bb-9dd8-dd82ad3c78eb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:19:48,664::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:19:48,665::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:19:48,665::task::990::TaskManager.Task::(_decref) Task=`2a7b23d3-ebf6-48bb-9dd8-dd82ad3c78eb`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:19:48,849::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-34::DEBUG::2014-08-21 11:19:48,850::task::595::TaskManager.Task::(_updateState) Task=`12366ac2-99c4-4f39-8eca-6633e95d7658`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:19:48,851::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:19:48,852::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7a82a1b1-7034-4b13-ae8e-26fbd89c0357`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:19:48,853::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:19:48,853::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:19:48,853::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7a82a1b1-7034-4b13-ae8e-26fbd89c0357`::Granted request
>Thread-34::DEBUG::2014-08-21 11:19:48,854::task::827::TaskManager.Task::(resourceAcquired) Task=`12366ac2-99c4-4f39-8eca-6633e95d7658`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:19:48,855::task::990::TaskManager.Task::(_decref) Task=`12366ac2-99c4-4f39-8eca-6633e95d7658`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:19:48,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894818816', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:48,859::task::1185::TaskManager.Task::(prepare) Task=`12366ac2-99c4-4f39-8eca-6633e95d7658`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894818816', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:48,860::task::595::TaskManager.Task::(_updateState) Task=`12366ac2-99c4-4f39-8eca-6633e95d7658`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:19:48,860::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:19:48,860::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:19:48,861::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:19:48,861::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:19:48,861::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:19:48,861::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:19:48,862::task::990::TaskManager.Task::(_decref) Task=`12366ac2-99c4-4f39-8eca-6633e95d7658`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:19:48,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.08037 s, 492 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:51,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:51,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.141038 s, 7.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:53,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:54,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.16926 s, 876 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:19:56,420::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:19:56,597::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000972081 s, 512 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:19:56,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:56,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.181787 s, 5.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:19:58,890::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-13::DEBUG::2014-08-21 11:19:58,892::task::595::TaskManager.Task::(_updateState) Task=`4b624983-39a0-4aa3-83d8-0eaf6a3a3c87`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:19:58,892::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:19:58,893::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:19:58,893::task::1185::TaskManager.Task::(prepare) Task=`4b624983-39a0-4aa3-83d8-0eaf6a3a3c87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:19:58,893::task::595::TaskManager.Task::(_updateState) Task=`4b624983-39a0-4aa3-83d8-0eaf6a3a3c87`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:19:58,893::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:19:58,894::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:19:58,894::task::990::TaskManager.Task::(_decref) Task=`4b624983-39a0-4aa3-83d8-0eaf6a3a3c87`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:19:58,900::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-34::DEBUG::2014-08-21 11:19:58,901::task::595::TaskManager.Task::(_updateState) Task=`6b01eeeb-0f44-4199-bda8-67cc95b2031d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:19:58,901::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:19:58,902::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a5dd21cf-92f8-4a90-95eb-e243052292a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:19:58,903::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:19:58,903::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:19:58,903::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a5dd21cf-92f8-4a90-95eb-e243052292a3`::Granted request
>Thread-34::DEBUG::2014-08-21 11:19:58,904::task::827::TaskManager.Task::(resourceAcquired) Task=`6b01eeeb-0f44-4199-bda8-67cc95b2031d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:19:58,905::task::990::TaskManager.Task::(_decref) Task=`6b01eeeb-0f44-4199-bda8-67cc95b2031d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:19:58,911::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894753280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:58,912::task::1185::TaskManager.Task::(prepare) Task=`6b01eeeb-0f44-4199-bda8-67cc95b2031d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894753280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:19:58,912::task::595::TaskManager.Task::(_updateState) Task=`6b01eeeb-0f44-4199-bda8-67cc95b2031d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:19:58,912::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:19:58,913::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:19:58,913::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:19:58,914::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:19:58,914::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:19:58,914::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:19:58,915::task::990::TaskManager.Task::(_decref) Task=`6b01eeeb-0f44-4199-bda8-67cc95b2031d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:19:58,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:19:59,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0661561 s, 15.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:20:00,894::task::595::TaskManager.Task::(_updateState) Task=`c84cfe6b-f412-4679-90b0-d9fc10c0e32f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:20:00,894::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:20:00,895::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000972081', 'lastCheck': '4.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:20:00,895::task::1185::TaskManager.Task::(prepare) Task=`c84cfe6b-f412-4679-90b0-d9fc10c0e32f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000972081', 'lastCheck': '4.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:20:00,895::task::595::TaskManager.Task::(_updateState) Task=`c84cfe6b-f412-4679-90b0-d9fc10c0e32f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:20:00,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:20:00,896::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:20:00,896::task::990::TaskManager.Task::(_decref) Task=`c84cfe6b-f412-4679-90b0-d9fc10c0e32f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:20:01,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:01,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110279 s, 9.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:03,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:03,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106817 s, 9.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:05,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:06,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0678032 s, 15.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:20:06,670::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:08,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:20:08,307::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 1.13274 s, 0.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:08,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0688037 s, 14.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:20:08,941::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-13::DEBUG::2014-08-21 11:20:08,942::task::595::TaskManager.Task::(_updateState) Task=`f543ab13-d65e-4b5c-8c4d-566d3acb511e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:20:08,942::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:20:08,943::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:20:08,943::task::1185::TaskManager.Task::(prepare) Task=`f543ab13-d65e-4b5c-8c4d-566d3acb511e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:20:08,943::task::595::TaskManager.Task::(_updateState) Task=`f543ab13-d65e-4b5c-8c4d-566d3acb511e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:20:08,944::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:20:08,944::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:20:08,944::task::990::TaskManager.Task::(_decref) Task=`f543ab13-d65e-4b5c-8c4d-566d3acb511e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:20:08,948::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-34::DEBUG::2014-08-21 11:20:08,949::task::595::TaskManager.Task::(_updateState) Task=`869ba0ec-b2e2-4d06-8cc9-893398483ca1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:20:08,949::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:20:08,950::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dfcf1b72-95b5-4bc7-8dbb-14a26cb943a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:20:08,950::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:20:08,951::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:20:08,951::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dfcf1b72-95b5-4bc7-8dbb-14a26cb943a9`::Granted request
>Thread-34::DEBUG::2014-08-21 11:20:08,951::task::827::TaskManager.Task::(resourceAcquired) Task=`869ba0ec-b2e2-4d06-8cc9-893398483ca1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:20:08,952::task::990::TaskManager.Task::(_decref) Task=`869ba0ec-b2e2-4d06-8cc9-893398483ca1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:20:08,956::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:08,957::task::1185::TaskManager.Task::(prepare) Task=`869ba0ec-b2e2-4d06-8cc9-893398483ca1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:08,957::task::595::TaskManager.Task::(_updateState) Task=`869ba0ec-b2e2-4d06-8cc9-893398483ca1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:20:08,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:20:08,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:20:08,958::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:20:08,958::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:20:08,958::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:20:08,959::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:20:08,959::task::990::TaskManager.Task::(_decref) Task=`869ba0ec-b2e2-4d06-8cc9-893398483ca1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:20:10,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:10,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.268744 s, 3.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:12,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:13,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.343429 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:15,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:15,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.249894 s, 4.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:20:16,836::task::595::TaskManager.Task::(_updateState) Task=`5a557aca-9924-4563-8c96-b7ba6c31a18f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:20:16,837::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:20:16,838::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '1.13274', 'lastCheck': '8.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:20:16,838::task::1185::TaskManager.Task::(prepare) Task=`5a557aca-9924-4563-8c96-b7ba6c31a18f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '1.13274', 'lastCheck': '8.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:20:16,839::task::595::TaskManager.Task::(_updateState) Task=`5a557aca-9924-4563-8c96-b7ba6c31a18f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:20:16,839::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:20:16,839::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:20:16,840::task::990::TaskManager.Task::(_decref) Task=`5a557aca-9924-4563-8c96-b7ba6c31a18f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:20:17,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:18,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0728812 s, 14.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:20:18,364::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:20:18,380::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000595719 s, 836 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:20:18,979::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-13::DEBUG::2014-08-21 11:20:18,980::task::595::TaskManager.Task::(_updateState) Task=`f265ecf7-b168-4219-a357-e260e926c0be`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:20:18,980::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:20:18,981::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:20:18,981::task::1185::TaskManager.Task::(prepare) Task=`f265ecf7-b168-4219-a357-e260e926c0be`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:20:18,982::task::595::TaskManager.Task::(_updateState) Task=`f265ecf7-b168-4219-a357-e260e926c0be`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:20:18,982::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:20:18,982::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:20:18,983::task::990::TaskManager.Task::(_decref) Task=`f265ecf7-b168-4219-a357-e260e926c0be`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:20:18,990::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-34::DEBUG::2014-08-21 11:20:18,991::task::595::TaskManager.Task::(_updateState) Task=`332d5ded-10aa-47e8-92bd-436e0c1cbfec`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:20:18,991::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:20:18,992::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1be2ea55-898b-4454-b156-85a5401277b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:20:18,993::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:20:18,993::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:20:18,993::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1be2ea55-898b-4454-b156-85a5401277b0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:20:18,994::task::827::TaskManager.Task::(resourceAcquired) Task=`332d5ded-10aa-47e8-92bd-436e0c1cbfec`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:20:18,994::task::990::TaskManager.Task::(_decref) Task=`332d5ded-10aa-47e8-92bd-436e0c1cbfec`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:20:19,003::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:19,004::task::1185::TaskManager.Task::(prepare) Task=`332d5ded-10aa-47e8-92bd-436e0c1cbfec`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:19,004::task::595::TaskManager.Task::(_updateState) Task=`332d5ded-10aa-47e8-92bd-436e0c1cbfec`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:20:19,004::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:20:19,005::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:20:19,005::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:20:19,006::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:20:19,006::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:20:19,006::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:20:19,007::task::990::TaskManager.Task::(_decref) Task=`332d5ded-10aa-47e8-92bd-436e0c1cbfec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:20:20,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:20,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.401859 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:22,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:22,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0519212 s, 19.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:25,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:25,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116919 s, 8.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:27,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:27,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493494 s, 20.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:20:28,404::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:20:28,476::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000941991 s, 529 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:20:29,066::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-13::DEBUG::2014-08-21 11:20:29,067::task::595::TaskManager.Task::(_updateState) Task=`b5d4b40c-9e42-48ce-942e-43f1d434c5b9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:20:29,068::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:20:29,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:20:29,069::task::1185::TaskManager.Task::(prepare) Task=`b5d4b40c-9e42-48ce-942e-43f1d434c5b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:20:29,069::task::595::TaskManager.Task::(_updateState) Task=`b5d4b40c-9e42-48ce-942e-43f1d434c5b9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:20:29,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:20:29,069::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:20:29,070::task::990::TaskManager.Task::(_decref) Task=`b5d4b40c-9e42-48ce-942e-43f1d434c5b9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:20:29,076::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-34::DEBUG::2014-08-21 11:20:29,077::task::595::TaskManager.Task::(_updateState) Task=`21a6e319-1c28-4ad9-99e4-96d08359fbad`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:20:29,077::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:20:29,078::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`536b13b6-7fec-4fd5-8aa4-436849845758`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:20:29,079::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:20:29,079::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:20:29,080::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`536b13b6-7fec-4fd5-8aa4-436849845758`::Granted request
>Thread-34::DEBUG::2014-08-21 11:20:29,080::task::827::TaskManager.Task::(resourceAcquired) Task=`21a6e319-1c28-4ad9-99e4-96d08359fbad`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:20:29,081::task::990::TaskManager.Task::(_decref) Task=`21a6e319-1c28-4ad9-99e4-96d08359fbad`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:20:29,087::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:29,087::task::1185::TaskManager.Task::(prepare) Task=`21a6e319-1c28-4ad9-99e4-96d08359fbad`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:29,087::task::595::TaskManager.Task::(_updateState) Task=`21a6e319-1c28-4ad9-99e4-96d08359fbad`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:20:29,088::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:20:29,088::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:20:29,089::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:20:29,089::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:20:29,089::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:20:29,089::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:20:29,090::task::990::TaskManager.Task::(_decref) Task=`21a6e319-1c28-4ad9-99e4-96d08359fbad`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:20:29,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:20:31,999::task::595::TaskManager.Task::(_updateState) Task=`7c667c77-b2fd-41b7-95ec-12fbc8677527`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:20:31,999::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:20:32,000::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000941991', 'lastCheck': '3.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:20:32,000::task::1185::TaskManager.Task::(prepare) Task=`7c667c77-b2fd-41b7-95ec-12fbc8677527`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000941991', 'lastCheck': '3.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:20:32,001::task::595::TaskManager.Task::(_updateState) Task=`7c667c77-b2fd-41b7-95ec-12fbc8677527`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:20:32,001::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:20:32,001::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:20:32,002::task::990::TaskManager.Task::(_decref) Task=`7c667c77-b2fd-41b7-95ec-12fbc8677527`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:20:32,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.53873 s, 403 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:34,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:34,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111489 s, 9.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:36,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:20:39,480::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-26::DEBUG::2014-08-21 11:20:39,482::task::595::TaskManager.Task::(_updateState) Task=`8ac6dd4f-6b07-4413-9a9b-7f470a5d9216`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:20:39,482::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:20:39,490::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:20:39,490::task::1185::TaskManager.Task::(prepare) Task=`8ac6dd4f-6b07-4413-9a9b-7f470a5d9216`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:20:39,491::task::595::TaskManager.Task::(_updateState) Task=`8ac6dd4f-6b07-4413-9a9b-7f470a5d9216`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:20:39,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:20:39,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:20:39,492::task::990::TaskManager.Task::(_decref) Task=`8ac6dd4f-6b07-4413-9a9b-7f470a5d9216`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:20:39,846::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-34::DEBUG::2014-08-21 11:20:39,848::task::595::TaskManager.Task::(_updateState) Task=`163764a4-bfd4-4ef9-98c8-81d167d9a133`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:20:39,849::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:20:39,851::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`095fb88e-5298-4ea0-a6a6-b1b8697d8411`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:20:39,851::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:20:39,852::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:20:39,853::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`095fb88e-5298-4ea0-a6a6-b1b8697d8411`::Granted request
>Thread-34::DEBUG::2014-08-21 11:20:39,859::task::827::TaskManager.Task::(resourceAcquired) Task=`163764a4-bfd4-4ef9-98c8-81d167d9a133`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:20:39,874::task::990::TaskManager.Task::(_decref) Task=`163764a4-bfd4-4ef9-98c8-81d167d9a133`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:20:39,981::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:39,982::task::1185::TaskManager.Task::(prepare) Task=`163764a4-bfd4-4ef9-98c8-81d167d9a133`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:39,983::task::595::TaskManager.Task::(_updateState) Task=`163764a4-bfd4-4ef9-98c8-81d167d9a133`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:20:39,983::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:20:39,984::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:20:39,992::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:20:39,993::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:20:39,993::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:20:39,994::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:20:39,995::task::990::TaskManager.Task::(_decref) Task=`163764a4-bfd4-4ef9-98c8-81d167d9a133`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:20:40,420::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:20:40,499::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000850457 s, 586 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:40,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.67117 s, 613 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:42,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:44,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.599832 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:46,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:46,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0508983 s, 20.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:20:48,443::task::595::TaskManager.Task::(_updateState) Task=`8afa3713-d5dc-4989-b6ae-e3b70bf2be13`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:20:48,443::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:20:48,444::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000850457', 'lastCheck': '7.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:20:48,444::task::1185::TaskManager.Task::(prepare) Task=`8afa3713-d5dc-4989-b6ae-e3b70bf2be13`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000850457', 'lastCheck': '7.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:20:48,444::task::595::TaskManager.Task::(_updateState) Task=`8afa3713-d5dc-4989-b6ae-e3b70bf2be13`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:20:48,444::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:20:48,444::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:20:48,445::task::990::TaskManager.Task::(_decref) Task=`8afa3713-d5dc-4989-b6ae-e3b70bf2be13`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:20:48,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:48,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0523155 s, 19.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:20:50,294::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-26::DEBUG::2014-08-21 11:20:50,347::task::595::TaskManager.Task::(_updateState) Task=`dc4ad4cc-c669-470c-af77-c7faa7dc61a4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:20:50,395::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:20:50,397::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:20:50,398::task::1185::TaskManager.Task::(prepare) Task=`dc4ad4cc-c669-470c-af77-c7faa7dc61a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:20:50,414::task::595::TaskManager.Task::(_updateState) Task=`dc4ad4cc-c669-470c-af77-c7faa7dc61a4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:20:50,421::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:20:50,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:20:50,422::task::990::TaskManager.Task::(_decref) Task=`dc4ad4cc-c669-470c-af77-c7faa7dc61a4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:20:50,447::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-34::DEBUG::2014-08-21 11:20:50,448::task::595::TaskManager.Task::(_updateState) Task=`5da84995-b455-44a2-a296-4ed62f9d75ad`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:20:50,449::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:20:50,449::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d52dc008-00ff-476f-be6f-90ffdbcea605`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:20:50,450::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:20:50,450::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:20:50,451::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d52dc008-00ff-476f-be6f-90ffdbcea605`::Granted request
>Thread-34::DEBUG::2014-08-21 11:20:50,451::task::827::TaskManager.Task::(resourceAcquired) Task=`5da84995-b455-44a2-a296-4ed62f9d75ad`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:20:50,451::task::990::TaskManager.Task::(_decref) Task=`5da84995-b455-44a2-a296-4ed62f9d75ad`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:20:50,457::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:50,458::task::1185::TaskManager.Task::(prepare) Task=`5da84995-b455-44a2-a296-4ed62f9d75ad`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:20:50,458::task::595::TaskManager.Task::(_updateState) Task=`5da84995-b455-44a2-a296-4ed62f9d75ad`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:20:50,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:20:50,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:20:50,460::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:20:50,460::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:20:50,460::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:20:50,460::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:20:50,461::task::990::TaskManager.Task::(_decref) Task=`5da84995-b455-44a2-a296-4ed62f9d75ad`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:20:50,707::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:20:50,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:20:51,257::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0100165 s, 49.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:52,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.740711 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:20:59,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:21:01,993::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-13::DEBUG::2014-08-21 11:21:02,005::task::595::TaskManager.Task::(_updateState) Task=`ca6e4fb2-f55e-4907-ba7d-513827123e16`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:21:02,009::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:21:02,013::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:02,015::task::1185::TaskManager.Task::(prepare) Task=`ca6e4fb2-f55e-4907-ba7d-513827123e16`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:02,017::task::595::TaskManager.Task::(_updateState) Task=`ca6e4fb2-f55e-4907-ba7d-513827123e16`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:21:02,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:21:02,021::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:21:02,021::task::990::TaskManager.Task::(_decref) Task=`ca6e4fb2-f55e-4907-ba7d-513827123e16`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:21:02,038::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-34::DEBUG::2014-08-21 11:21:02,070::task::595::TaskManager.Task::(_updateState) Task=`64e32454-3fdb-444f-b173-9ac05192a93b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:21:02,075::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:21:02,089::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`52fd7c9a-acc0-40f9-857b-302986b8aece`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:21:02,090::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:21:02,090::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:21:02,090::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`52fd7c9a-acc0-40f9-857b-302986b8aece`::Granted request
>Thread-34::DEBUG::2014-08-21 11:21:02,091::task::827::TaskManager.Task::(resourceAcquired) Task=`64e32454-3fdb-444f-b173-9ac05192a93b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:21:02,091::task::990::TaskManager.Task::(_decref) Task=`64e32454-3fdb-444f-b173-9ac05192a93b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:21:02,128::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:02,128::task::1185::TaskManager.Task::(prepare) Task=`64e32454-3fdb-444f-b173-9ac05192a93b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:02,128::task::595::TaskManager.Task::(_updateState) Task=`64e32454-3fdb-444f-b173-9ac05192a93b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:21:02,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:21:02,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:21:02,130::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:21:02,130::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:21:02,130::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:21:02,130::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:21:02,131::task::990::TaskManager.Task::(_decref) Task=`64e32454-3fdb-444f-b173-9ac05192a93b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:21:02,165::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:21:02,189::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000554717 s, 898 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:02,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.291865 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:04,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:04,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0466104 s, 22.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:06,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:06,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105851 s, 9.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:21:08,017::task::595::TaskManager.Task::(_updateState) Task=`f108b203-e888-402e-a4c8-22bffe41ddac`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:21:08,019::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:21:08,020::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554717', 'lastCheck': '5.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:21:08,020::task::1185::TaskManager.Task::(prepare) Task=`f108b203-e888-402e-a4c8-22bffe41ddac`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554717', 'lastCheck': '5.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:21:08,020::task::595::TaskManager.Task::(_updateState) Task=`f108b203-e888-402e-a4c8-22bffe41ddac`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:21:08,020::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:21:08,021::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:21:08,021::task::990::TaskManager.Task::(_decref) Task=`f108b203-e888-402e-a4c8-22bffe41ddac`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:21:09,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:09,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.706311 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:11,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:21:22,227::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-13::DEBUG::2014-08-21 11:21:22,240::task::595::TaskManager.Task::(_updateState) Task=`f4908ccd-500d-4af8-92e3-b9c0d1b09f50`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:21:22,241::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:21:22,242::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:22,243::task::1185::TaskManager.Task::(prepare) Task=`f4908ccd-500d-4af8-92e3-b9c0d1b09f50`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:22,243::task::595::TaskManager.Task::(_updateState) Task=`f4908ccd-500d-4af8-92e3-b9c0d1b09f50`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:21:22,244::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:21:22,261::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:21:22,267::task::990::TaskManager.Task::(_decref) Task=`f4908ccd-500d-4af8-92e3-b9c0d1b09f50`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:21:22,334::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3828caec]
>Thread-34::DEBUG::2014-08-21 11:21:22,345::task::595::TaskManager.Task::(_updateState) Task=`1a241221-d65a-48ff-ab24-24c27e767e98`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:21:22,352::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:21:22,367::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f26ba175-cd7c-4cb6-9b38-030a400bac89`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:21:22,372::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:21:22,382::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:21:22,388::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f26ba175-cd7c-4cb6-9b38-030a400bac89`::Granted request
>Thread-34::DEBUG::2014-08-21 11:21:22,402::task::827::TaskManager.Task::(resourceAcquired) Task=`1a241221-d65a-48ff-ab24-24c27e767e98`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:21:22,407::task::990::TaskManager.Task::(_decref) Task=`1a241221-d65a-48ff-ab24-24c27e767e98`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:21:22,421::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:21:22,496::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00190956 s, 261 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:21:22,529::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:22,535::task::1185::TaskManager.Task::(prepare) Task=`1a241221-d65a-48ff-ab24-24c27e767e98`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:22,539::task::595::TaskManager.Task::(_updateState) Task=`1a241221-d65a-48ff-ab24-24c27e767e98`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:21:22,543::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:21:22,553::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:21:22,572::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:21:22,588::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:21:22,598::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:21:22,608::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:21:22,612::task::990::TaskManager.Task::(_decref) Task=`1a241221-d65a-48ff-ab24-24c27e767e98`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:21:22,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.477973 s, 2.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:24,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:28,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0728661 s, 14.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:30,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:32,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.303248 s, 3.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:21:32,659::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-13::DEBUG::2014-08-21 11:21:32,793::task::595::TaskManager.Task::(_updateState) Task=`12364972-12aa-41c9-9da6-1732ba8943c4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:21:32,794::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:21:32,795::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:32,795::task::1185::TaskManager.Task::(prepare) Task=`12364972-12aa-41c9-9da6-1732ba8943c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:32,795::task::595::TaskManager.Task::(_updateState) Task=`12364972-12aa-41c9-9da6-1732ba8943c4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:21:32,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:21:32,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:21:32,796::task::990::TaskManager.Task::(_decref) Task=`12364972-12aa-41c9-9da6-1732ba8943c4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:21:32,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:21:33,047::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00959332 s, 51.9 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:21:33,059::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-34::DEBUG::2014-08-21 11:21:33,065::task::595::TaskManager.Task::(_updateState) Task=`740ce87c-829e-416a-80c9-2bef589eaaaa`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:21:33,069::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:21:33,093::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d02068d9-ff60-4b4e-9a8d-277c24d9c174`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:21:33,125::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:21:33,126::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:21:33,127::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d02068d9-ff60-4b4e-9a8d-277c24d9c174`::Granted request
>Thread-34::DEBUG::2014-08-21 11:21:33,206::task::827::TaskManager.Task::(resourceAcquired) Task=`740ce87c-829e-416a-80c9-2bef589eaaaa`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:21:33,276::task::990::TaskManager.Task::(_decref) Task=`740ce87c-829e-416a-80c9-2bef589eaaaa`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:21:33,314::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:33,315::task::1185::TaskManager.Task::(prepare) Task=`740ce87c-829e-416a-80c9-2bef589eaaaa`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:33,316::task::595::TaskManager.Task::(_updateState) Task=`740ce87c-829e-416a-80c9-2bef589eaaaa`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:21:33,392::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:21:33,411::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:21:33,417::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:21:33,419::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:21:33,420::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:21:33,422::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:21:33,422::task::990::TaskManager.Task::(_decref) Task=`740ce87c-829e-416a-80c9-2bef589eaaaa`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:21:34,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:34,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0679562 s, 15.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:21:35,145::task::595::TaskManager.Task::(_updateState) Task=`7e604fd5-c649-4cd7-a9ff-c4c8a02cf38d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:21:35,145::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:21:35,146::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00959332', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:21:35,146::task::1185::TaskManager.Task::(prepare) Task=`7e604fd5-c649-4cd7-a9ff-c4c8a02cf38d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00959332', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:21:35,146::task::595::TaskManager.Task::(_updateState) Task=`7e604fd5-c649-4cd7-a9ff-c4c8a02cf38d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:21:35,146::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:21:35,146::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:21:35,147::task::990::TaskManager.Task::(_decref) Task=`7e604fd5-c649-4cd7-a9ff-c4c8a02cf38d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:21:36,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:38,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.948585 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:40,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:40,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.171838 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:42,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:43,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.696546 s, 1.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:21:43,345::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:21:43,372::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00413457 s, 120 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:21:43,464::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5382417d]
>Thread-13::DEBUG::2014-08-21 11:21:43,465::task::595::TaskManager.Task::(_updateState) Task=`ea761033-4f64-4f67-a33c-4a3406f070dd`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:21:43,466::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:21:43,467::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:43,467::task::1185::TaskManager.Task::(prepare) Task=`ea761033-4f64-4f67-a33c-4a3406f070dd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:43,468::task::595::TaskManager.Task::(_updateState) Task=`ea761033-4f64-4f67-a33c-4a3406f070dd`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:21:43,468::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:21:43,468::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:21:43,469::task::990::TaskManager.Task::(_decref) Task=`ea761033-4f64-4f67-a33c-4a3406f070dd`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:21:43,476::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5382417d]
>Thread-34::DEBUG::2014-08-21 11:21:43,479::task::595::TaskManager.Task::(_updateState) Task=`aa93f674-dca3-4412-9501-60d6538b01e0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:21:43,482::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:21:43,486::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`037d8f4e-cb7e-4785-843d-63a24aaf95af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:21:43,487::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:21:43,488::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:21:43,524::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`037d8f4e-cb7e-4785-843d-63a24aaf95af`::Granted request
>Thread-34::DEBUG::2014-08-21 11:21:43,531::task::827::TaskManager.Task::(resourceAcquired) Task=`aa93f674-dca3-4412-9501-60d6538b01e0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:21:43,532::task::990::TaskManager.Task::(_decref) Task=`aa93f674-dca3-4412-9501-60d6538b01e0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:21:43,553::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:43,555::task::1185::TaskManager.Task::(prepare) Task=`aa93f674-dca3-4412-9501-60d6538b01e0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:43,556::task::595::TaskManager.Task::(_updateState) Task=`aa93f674-dca3-4412-9501-60d6538b01e0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:21:43,557::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:21:43,558::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:21:43,559::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:21:43,560::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:21:43,561::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:21:43,561::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:21:43,562::task::990::TaskManager.Task::(_decref) Task=`aa93f674-dca3-4412-9501-60d6538b01e0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:21:45,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:45,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0953538 s, 10.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:47,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:47,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0567625 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:49,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:49,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107975 s, 9.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:21:50,279::task::595::TaskManager.Task::(_updateState) Task=`7a7befc7-e097-480c-82f2-b1fd7a2a5a34`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:21:50,280::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:21:50,281::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00413457', 'lastCheck': '6.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:21:50,282::task::1185::TaskManager.Task::(prepare) Task=`7a7befc7-e097-480c-82f2-b1fd7a2a5a34`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00413457', 'lastCheck': '6.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:21:50,282::task::595::TaskManager.Task::(_updateState) Task=`7a7befc7-e097-480c-82f2-b1fd7a2a5a34`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:21:50,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:21:50,283::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:21:50,284::task::990::TaskManager.Task::(_decref) Task=`7a7befc7-e097-480c-82f2-b1fd7a2a5a34`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:21:51,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:51,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530298 s, 19.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:21:53,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:21:53,414::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000477582 s, 1.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:21:53,582::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14a1da75]
>Thread-13::DEBUG::2014-08-21 11:21:53,583::task::595::TaskManager.Task::(_updateState) Task=`5d83b259-05e6-45d4-aaa0-c342d10b2768`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:21:53,584::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:21:53,585::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:53,585::task::1185::TaskManager.Task::(prepare) Task=`5d83b259-05e6-45d4-aaa0-c342d10b2768`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:21:53,586::task::595::TaskManager.Task::(_updateState) Task=`5d83b259-05e6-45d4-aaa0-c342d10b2768`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:21:53,586::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:21:53,586::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:21:53,587::task::990::TaskManager.Task::(_decref) Task=`5d83b259-05e6-45d4-aaa0-c342d10b2768`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:21:53,595::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14a1da75]
>Thread-34::DEBUG::2014-08-21 11:21:53,599::task::595::TaskManager.Task::(_updateState) Task=`12ba457a-a40e-44dd-bf60-84e2e685f3ac`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:21:53,601::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:21:53,604::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a8db853e-c4f2-443e-8982-b70c17e285c0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:21:53,605::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:21:53,606::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:21:53,608::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a8db853e-c4f2-443e-8982-b70c17e285c0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:21:53,613::task::827::TaskManager.Task::(resourceAcquired) Task=`12ba457a-a40e-44dd-bf60-84e2e685f3ac`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:21:53,615::task::990::TaskManager.Task::(_decref) Task=`12ba457a-a40e-44dd-bf60-84e2e685f3ac`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:21:53,649::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:53,650::task::1185::TaskManager.Task::(prepare) Task=`12ba457a-a40e-44dd-bf60-84e2e685f3ac`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:21:53,652::task::595::TaskManager.Task::(_updateState) Task=`12ba457a-a40e-44dd-bf60-84e2e685f3ac`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:21:53,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:21:53,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:21:53,656::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:21:53,657::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:21:53,659::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:21:53,661::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:21:53,663::task::990::TaskManager.Task::(_decref) Task=`12ba457a-a40e-44dd-bf60-84e2e685f3ac`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:21:53,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:54,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.130182 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:56,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:56,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511416 s, 20.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:21:58,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:21:58,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0562177 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:22:00,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:00,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0553182 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:22:02,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:02,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048103 s, 21.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:22:03,434::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:22:03,451::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000458204 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:22:03,705::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-13::DEBUG::2014-08-21 11:22:03,711::task::595::TaskManager.Task::(_updateState) Task=`f1415832-5de6-4cef-8594-a6b1b7fb0131`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:22:03,714::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:22:03,721::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:22:03,723::task::1185::TaskManager.Task::(prepare) Task=`f1415832-5de6-4cef-8594-a6b1b7fb0131`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:22:03,724::task::595::TaskManager.Task::(_updateState) Task=`f1415832-5de6-4cef-8594-a6b1b7fb0131`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:22:03,726::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:22:03,727::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:22:03,729::task::990::TaskManager.Task::(_decref) Task=`f1415832-5de6-4cef-8594-a6b1b7fb0131`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:22:03,740::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-34::DEBUG::2014-08-21 11:22:03,743::task::595::TaskManager.Task::(_updateState) Task=`e7ade8d0-3185-478c-ba43-63dc5db2efbb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:22:03,745::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:22:03,747::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4767b97c-1227-4761-bd00-64903c2eb697`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:22:03,747::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:22:03,749::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:22:03,750::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4767b97c-1227-4761-bd00-64903c2eb697`::Granted request
>Thread-34::DEBUG::2014-08-21 11:22:03,753::task::827::TaskManager.Task::(resourceAcquired) Task=`e7ade8d0-3185-478c-ba43-63dc5db2efbb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:22:03,754::task::990::TaskManager.Task::(_decref) Task=`e7ade8d0-3185-478c-ba43-63dc5db2efbb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:22:03,783::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:22:03,785::task::1185::TaskManager.Task::(prepare) Task=`e7ade8d0-3185-478c-ba43-63dc5db2efbb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:22:03,786::task::595::TaskManager.Task::(_updateState) Task=`e7ade8d0-3185-478c-ba43-63dc5db2efbb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:22:03,787::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:22:03,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:22:03,790::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:22:03,791::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:22:03,792::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:22:03,793::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:22:03,794::task::990::TaskManager.Task::(_decref) Task=`e7ade8d0-3185-478c-ba43-63dc5db2efbb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:22:04,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:05,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0736189 s, 13.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:22:05,471::task::595::TaskManager.Task::(_updateState) Task=`226eba62-ec82-4b0d-99ae-a7412d07a618`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:22:05,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:22:05,472::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458204', 'lastCheck': '2.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:22:05,473::task::1185::TaskManager.Task::(prepare) Task=`226eba62-ec82-4b0d-99ae-a7412d07a618`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458204', 'lastCheck': '2.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:22:05,473::task::595::TaskManager.Task::(_updateState) Task=`226eba62-ec82-4b0d-99ae-a7412d07a618`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:22:05,473::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:22:05,474::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:22:05,474::task::990::TaskManager.Task::(_decref) Task=`226eba62-ec82-4b0d-99ae-a7412d07a618`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:22:07,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:07,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.172531 s, 5.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:22:09,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:09,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.160248 s, 6.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:22:11,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:11,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.113717 s, 9.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:22:13,459::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:22:13,491::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:22:13,513::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:22:13,527::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 11:22:13,531::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:22:13,532::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:22:13,532::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 11:22:13,564::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:22:13,584::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000668314 s, 745 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:22:13,826::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-13::DEBUG::2014-08-21 11:22:13,827::task::595::TaskManager.Task::(_updateState) Task=`f7f86c72-32f3-459a-a50b-fa93c1d77d96`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:22:13,831::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:22:13,834::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:22:13,946::task::1185::TaskManager.Task::(prepare) Task=`f7f86c72-32f3-459a-a50b-fa93c1d77d96`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:22:13,947::task::595::TaskManager.Task::(_updateState) Task=`f7f86c72-32f3-459a-a50b-fa93c1d77d96`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:22:13,948::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:22:13,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:22:14,100::task::990::TaskManager.Task::(_decref) Task=`f7f86c72-32f3-459a-a50b-fa93c1d77d96`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:22:14,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:22:15,761::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-34::DEBUG::2014-08-21 11:22:15,910::task::595::TaskManager.Task::(_updateState) Task=`1e50a6d5-37f3-48c4-a157-8bef25ebe332`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:22:15,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:22:15,933::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c2297a60-127f-47ae-b49f-8449e773bc6d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:22:15,935::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:22:15,938::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:22:15,940::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c2297a60-127f-47ae-b49f-8449e773bc6d`::Granted request
>Thread-34::DEBUG::2014-08-21 11:22:15,944::task::827::TaskManager.Task::(resourceAcquired) Task=`1e50a6d5-37f3-48c4-a157-8bef25ebe332`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:22:15,947::task::990::TaskManager.Task::(_decref) Task=`1e50a6d5-37f3-48c4-a157-8bef25ebe332`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:22:16,006::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:22:16,009::task::1185::TaskManager.Task::(prepare) Task=`1e50a6d5-37f3-48c4-a157-8bef25ebe332`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:22:16,011::task::595::TaskManager.Task::(_updateState) Task=`1e50a6d5-37f3-48c4-a157-8bef25ebe332`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:22:16,013::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:22:16,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:22:16,019::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:22:16,023::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:22:16,025::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:22:16,027::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:22:16,031::task::990::TaskManager.Task::(_decref) Task=`1e50a6d5-37f3-48c4-a157-8bef25ebe332`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:22:16,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.53415 s, 667 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:22:18,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:18,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0647587 s, 15.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:22:20,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:20,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0867666 s, 11.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:22:21,981::task::595::TaskManager.Task::(_updateState) Task=`d2cc134a-5a99-429b-bdff-a10589e81894`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:22:21,982::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:22:21,982::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668314', 'lastCheck': '8.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:22:21,983::task::1185::TaskManager.Task::(prepare) Task=`d2cc134a-5a99-429b-bdff-a10589e81894`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668314', 'lastCheck': '8.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:22:21,983::task::595::TaskManager.Task::(_updateState) Task=`d2cc134a-5a99-429b-bdff-a10589e81894`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:22:21,983::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:22:21,984::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:22:21,984::task::990::TaskManager.Task::(_decref) Task=`d2cc134a-5a99-429b-bdff-a10589e81894`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:22:36,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:22:40,477::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-26::DEBUG::2014-08-21 11:22:41,343::task::595::TaskManager.Task::(_updateState) Task=`066e2994-b003-4647-b238-a3f9745102f0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:22:41,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:22:41,356::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:22:41,361::task::1185::TaskManager.Task::(prepare) Task=`066e2994-b003-4647-b238-a3f9745102f0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:22:41,363::task::595::TaskManager.Task::(_updateState) Task=`066e2994-b003-4647-b238-a3f9745102f0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:22:41,365::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:22:41,369::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 11:22:41,370::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:22:41,373::task::990::TaskManager.Task::(_decref) Task=`066e2994-b003-4647-b238-a3f9745102f0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:22:41,517::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-34::DEBUG::2014-08-21 11:22:41,539::task::595::TaskManager.Task::(_updateState) Task=`ee8fbafd-eb10-4df0-81da-e72ea0d280c2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:22:41,558::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 11:22:41,568::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0121553 s, 41.0 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:22:41,582::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`edc6e034-36a4-4600-bdfb-0550d09e70f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:22:41,588::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:22:41,598::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:22:41,604::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`edc6e034-36a4-4600-bdfb-0550d09e70f9`::Granted request
>Thread-34::DEBUG::2014-08-21 11:22:41,619::task::827::TaskManager.Task::(resourceAcquired) Task=`ee8fbafd-eb10-4df0-81da-e72ea0d280c2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:22:41,624::task::990::TaskManager.Task::(_decref) Task=`ee8fbafd-eb10-4df0-81da-e72ea0d280c2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:22:41,724::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:22:41,729::task::1185::TaskManager.Task::(prepare) Task=`ee8fbafd-eb10-4df0-81da-e72ea0d280c2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:22:41,734::task::595::TaskManager.Task::(_updateState) Task=`ee8fbafd-eb10-4df0-81da-e72ea0d280c2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:22:41,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:22:41,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:22:41,738::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:22:41,740::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:22:41,742::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:22:41,743::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:22:41,746::task::990::TaskManager.Task::(_decref) Task=`ee8fbafd-eb10-4df0-81da-e72ea0d280c2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:22:41,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.79761 s, 270 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:22:43,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:47,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.96819 s, 345 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:22:49,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:22:50,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.537224 s, 1.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:22:52,005::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-26::DEBUG::2014-08-21 11:22:52,007::task::595::TaskManager.Task::(_updateState) Task=`f0c3aed7-ab48-4f3a-9814-f9b55a505b14`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:22:52,008::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:22:52,168::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:22:52,168::task::1185::TaskManager.Task::(prepare) Task=`f0c3aed7-ab48-4f3a-9814-f9b55a505b14`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:22:52,169::task::595::TaskManager.Task::(_updateState) Task=`f0c3aed7-ab48-4f3a-9814-f9b55a505b14`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:22:52,169::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:22:52,169::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:22:52,170::task::990::TaskManager.Task::(_decref) Task=`f0c3aed7-ab48-4f3a-9814-f9b55a505b14`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:22:54,707::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Dummy-33::DEBUG::2014-08-21 11:22:55,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:22:55,306::task::595::TaskManager.Task::(_updateState) Task=`ed2049c4-baae-4b7e-a546-a7f699fab8f5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:22:55,613::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:22:55,861::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1f357a8-7f76-4557-b144-c1eb1fc4d976`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:22:55,862::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:22:55,863::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:22:55,868::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1f357a8-7f76-4557-b144-c1eb1fc4d976`::Granted request
>Thread-34::DEBUG::2014-08-21 11:22:55,872::task::827::TaskManager.Task::(resourceAcquired) Task=`ed2049c4-baae-4b7e-a546-a7f699fab8f5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:22:55,874::task::990::TaskManager.Task::(_decref) Task=`ed2049c4-baae-4b7e-a546-a7f699fab8f5`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:22:55,889::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:22:55,921::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:22:55,921::task::1185::TaskManager.Task::(prepare) Task=`ed2049c4-baae-4b7e-a546-a7f699fab8f5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:22:55,922::task::595::TaskManager.Task::(_updateState) Task=`ed2049c4-baae-4b7e-a546-a7f699fab8f5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:22:55,923::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:22:55,923::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:22:55,924::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:22:55,926::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:22:55,926::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:22:55,927::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:22:55,929::task::990::TaskManager.Task::(_decref) Task=`ed2049c4-baae-4b7e-a546-a7f699fab8f5`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:23:02,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 1.20688 s, 0.4 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:23:03,412::task::595::TaskManager.Task::(_updateState) Task=`cf2ce1f0-56e2-4e7b-b46c-4867e20d7d94`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:23:05,591::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:23:05,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121553', 'lastCheck': '24.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:23:09,586::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-13::DEBUG::2014-08-21 11:23:09,879::task::595::TaskManager.Task::(_updateState) Task=`23d1fc43-251c-484b-b363-ec5d57e209fa`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 11:23:09,778::task::1185::TaskManager.Task::(prepare) Task=`cf2ce1f0-56e2-4e7b-b46c-4867e20d7d94`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121553', 'lastCheck': '24.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:23:10,073::task::595::TaskManager.Task::(_updateState) Task=`cf2ce1f0-56e2-4e7b-b46c-4867e20d7d94`::moving from state preparing -> state finished
>Thread-13::INFO::2014-08-21 11:23:10,434::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::DEBUG::2014-08-21 11:23:10,502::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:23:10,582::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:23:10,583::task::990::TaskManager.Task::(_decref) Task=`cf2ce1f0-56e2-4e7b-b46c-4867e20d7d94`::ref 0 aborting False
>Thread-13::INFO::2014-08-21 11:23:10,572::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:23:10,686::task::1185::TaskManager.Task::(prepare) Task=`23d1fc43-251c-484b-b363-ec5d57e209fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:23:10,688::task::595::TaskManager.Task::(_updateState) Task=`23d1fc43-251c-484b-b363-ec5d57e209fa`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:23:10,688::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:23:10,688::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:23:10,689::task::990::TaskManager.Task::(_decref) Task=`23d1fc43-251c-484b-b363-ec5d57e209fa`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:23:10,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 11:23:11,063::task::595::TaskManager.Task::(_updateState) Task=`6990ad36-3d79-4883-9b7d-c99785477d83`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:23:11,065::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:23:11,071::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`41335902-371c-468e-8bb3-2a2667c58254`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:23:11,072::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:23:11,075::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:23:11,107::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`41335902-371c-468e-8bb3-2a2667c58254`::Granted request
>Thread-34::DEBUG::2014-08-21 11:23:11,119::task::827::TaskManager.Task::(resourceAcquired) Task=`6990ad36-3d79-4883-9b7d-c99785477d83`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:23:11,120::task::990::TaskManager.Task::(_decref) Task=`6990ad36-3d79-4883-9b7d-c99785477d83`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:23:11,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:23:11,250::task::1185::TaskManager.Task::(prepare) Task=`6990ad36-3d79-4883-9b7d-c99785477d83`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:23:11,255::task::595::TaskManager.Task::(_updateState) Task=`6990ad36-3d79-4883-9b7d-c99785477d83`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:23:11,255::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:23:11,255::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:23:11,264::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:23:11,269::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:23:11,269::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:23:11,270::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:23:11,271::task::990::TaskManager.Task::(_decref) Task=`6990ad36-3d79-4883-9b7d-c99785477d83`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:23:11,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 15.3816 s, 66.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:23:13,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:23:14,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.15591 s, 886 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:23:17,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:23:18,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.21201 s, 845 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:23:28,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:23:35,991::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-13::DEBUG::2014-08-21 11:23:36,311::task::595::TaskManager.Task::(_updateState) Task=`31b415d8-dc34-4ce5-a3da-f26a110c6ef5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:23:36,327::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:23:36,347::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:23:36,359::task::1185::TaskManager.Task::(prepare) Task=`31b415d8-dc34-4ce5-a3da-f26a110c6ef5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:23:36,371::task::595::TaskManager.Task::(_updateState) Task=`31b415d8-dc34-4ce5-a3da-f26a110c6ef5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:23:36,380::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:23:36,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:23:36,400::task::990::TaskManager.Task::(_decref) Task=`31b415d8-dc34-4ce5-a3da-f26a110c6ef5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:23:36,436::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 11:23:36,442::task::595::TaskManager.Task::(_updateState) Task=`a988c860-fbb3-4ecf-bf1c-c3469e11f053`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:23:36,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:23:36,449::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`82259efa-785f-4d09-9ac3-693e6cd8b736`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:23:36,452::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:23:36,458::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:23:36,462::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`82259efa-785f-4d09-9ac3-693e6cd8b736`::Granted request
>Thread-34::DEBUG::2014-08-21 11:23:36,469::task::827::TaskManager.Task::(resourceAcquired) Task=`a988c860-fbb3-4ecf-bf1c-c3469e11f053`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:23:36,473::task::990::TaskManager.Task::(_decref) Task=`a988c860-fbb3-4ecf-bf1c-c3469e11f053`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:23:36,565::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:23:36,567::task::1185::TaskManager.Task::(prepare) Task=`a988c860-fbb3-4ecf-bf1c-c3469e11f053`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:23:36,567::task::595::TaskManager.Task::(_updateState) Task=`a988c860-fbb3-4ecf-bf1c-c3469e11f053`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:23:36,568::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:23:36,568::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:23:36,578::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:23:36,582::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:23:36,582::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:23:36,583::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:23:36,583::task::990::TaskManager.Task::(_decref) Task=`a988c860-fbb3-4ecf-bf1c-c3469e11f053`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:23:36,630::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:23:36,670::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00157047 s, 317 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:23:36,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.878421 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:23:38,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:23:39,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.088595 s, 11.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:23:41,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:23:41,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0626785 s, 16.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:23:42,232::task::595::TaskManager.Task::(_updateState) Task=`7dc79a0a-b34c-46cd-945b-d9116562e1ec`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:23:42,233::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:23:42,233::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157047', 'lastCheck': '5.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:23:42,233::task::1185::TaskManager.Task::(prepare) Task=`7dc79a0a-b34c-46cd-945b-d9116562e1ec`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157047', 'lastCheck': '5.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:23:42,234::task::595::TaskManager.Task::(_updateState) Task=`7dc79a0a-b34c-46cd-945b-d9116562e1ec`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:23:42,234::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:23:42,234::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:23:42,234::task::990::TaskManager.Task::(_decref) Task=`7dc79a0a-b34c-46cd-945b-d9116562e1ec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:23:43,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:23:43,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106026 s, 9.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:23:45,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:23:45,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0651779 s, 15.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:23:46,643::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-13::DEBUG::2014-08-21 11:23:46,644::task::595::TaskManager.Task::(_updateState) Task=`1597e5fd-48e1-482b-986b-e0f06209ff46`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:23:46,645::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:23:46,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:23:46,646::task::1185::TaskManager.Task::(prepare) Task=`1597e5fd-48e1-482b-986b-e0f06209ff46`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:23:46,646::task::595::TaskManager.Task::(_updateState) Task=`1597e5fd-48e1-482b-986b-e0f06209ff46`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:23:46,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:23:46,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:23:46,647::task::990::TaskManager.Task::(_decref) Task=`1597e5fd-48e1-482b-986b-e0f06209ff46`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:23:46,684::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-34::DEBUG::2014-08-21 11:23:46,685::task::595::TaskManager.Task::(_updateState) Task=`eef3e5a6-9aa1-47da-bca6-b5a1db3576b3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:23:46,685::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:23:46,686::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a656211d-32bb-43ad-9477-63127338652e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:23:46,686::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:23:46,687::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:23:46,687::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a656211d-32bb-43ad-9477-63127338652e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:23:46,688::task::827::TaskManager.Task::(resourceAcquired) Task=`eef3e5a6-9aa1-47da-bca6-b5a1db3576b3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:23:46,688::task::990::TaskManager.Task::(_decref) Task=`eef3e5a6-9aa1-47da-bca6-b5a1db3576b3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:23:46,762::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:23:46,763::task::1185::TaskManager.Task::(prepare) Task=`eef3e5a6-9aa1-47da-bca6-b5a1db3576b3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:23:46,764::task::595::TaskManager.Task::(_updateState) Task=`eef3e5a6-9aa1-47da-bca6-b5a1db3576b3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:23:46,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:23:46,767::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:23:46,772::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:23:46,772::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:23:46,773::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:23:46,773::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:23:46,774::task::990::TaskManager.Task::(_decref) Task=`eef3e5a6-9aa1-47da-bca6-b5a1db3576b3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:23:46,999::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:23:47,650::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.015171 s, 32.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:23:47,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:24:02,107::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-26::DEBUG::2014-08-21 11:24:02,164::task::595::TaskManager.Task::(_updateState) Task=`79fc47ea-e406-4eaa-ab7d-396dd3039c4c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:24:02,168::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:24:02,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:24:02,186::task::1185::TaskManager.Task::(prepare) Task=`79fc47ea-e406-4eaa-ab7d-396dd3039c4c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:24:02,189::task::595::TaskManager.Task::(_updateState) Task=`79fc47ea-e406-4eaa-ab7d-396dd3039c4c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:24:02,194::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:24:02,226::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:24:02,247::task::990::TaskManager.Task::(_decref) Task=`79fc47ea-e406-4eaa-ab7d-396dd3039c4c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:24:02,274::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-34::DEBUG::2014-08-21 11:24:02,282::task::595::TaskManager.Task::(_updateState) Task=`03bfa816-ffe6-452a-a2fe-358591942135`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:24:02,284::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:24:02,292::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`20f63c69-82e7-4331-80a9-8d8f8786e754`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:24:02,294::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:24:02,296::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:24:02,299::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`20f63c69-82e7-4331-80a9-8d8f8786e754`::Granted request
>Thread-34::DEBUG::2014-08-21 11:24:02,303::task::827::TaskManager.Task::(resourceAcquired) Task=`03bfa816-ffe6-452a-a2fe-358591942135`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:24:02,305::task::990::TaskManager.Task::(_decref) Task=`03bfa816-ffe6-452a-a2fe-358591942135`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:24:02,327::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:24:02,329::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:02,344::task::1185::TaskManager.Task::(prepare) Task=`03bfa816-ffe6-452a-a2fe-358591942135`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:02,351::task::595::TaskManager.Task::(_updateState) Task=`03bfa816-ffe6-452a-a2fe-358591942135`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:24:02,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:24:02,370::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:24:02,378::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:24:02,381::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:24:02,383::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:24:02,384::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:24:02,387::task::990::TaskManager.Task::(_decref) Task=`03bfa816-ffe6-452a-a2fe-358591942135`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:24:02,391::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000882204 s, 564 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:24:02,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.63379 s, 282 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:24:04,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:24:04,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.146855 s, 7.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:24:06,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:24:06,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.065141 s, 15.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:24:08,168::task::595::TaskManager.Task::(_updateState) Task=`faacf52f-56b9-40b8-a641-4584a7677728`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:24:08,168::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:24:08,169::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000882204', 'lastCheck': '5.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:24:08,169::task::1185::TaskManager.Task::(prepare) Task=`faacf52f-56b9-40b8-a641-4584a7677728`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000882204', 'lastCheck': '5.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:24:08,169::task::595::TaskManager.Task::(_updateState) Task=`faacf52f-56b9-40b8-a641-4584a7677728`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:24:08,169::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:24:08,169::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:24:08,170::task::990::TaskManager.Task::(_decref) Task=`faacf52f-56b9-40b8-a641-4584a7677728`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:24:08,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:24:09,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0796392 s, 12.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:24:11,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:24:12,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.945901 s, 1.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:24:12,420::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-26::DEBUG::2014-08-21 11:24:12,426::task::595::TaskManager.Task::(_updateState) Task=`061d108c-c95a-4d6b-92b9-49d4d545420b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:24:12,427::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:24:12,430::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:24:12,434::task::1185::TaskManager.Task::(prepare) Task=`061d108c-c95a-4d6b-92b9-49d4d545420b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:24:12,437::task::595::TaskManager.Task::(_updateState) Task=`061d108c-c95a-4d6b-92b9-49d4d545420b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:24:12,440::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:24:12,444::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:24:12,448::task::990::TaskManager.Task::(_decref) Task=`061d108c-c95a-4d6b-92b9-49d4d545420b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:24:12,461::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:24:12,482::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-34::DEBUG::2014-08-21 11:24:12,483::task::595::TaskManager.Task::(_updateState) Task=`10a4e390-f344-4dd7-b7f8-64fe2a5d7054`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:24:12,483::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:24:12,493::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eb41170e-876e-440d-ad00-1768b45b88fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:24:12,494::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:24:12,496::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:24:12,498::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eb41170e-876e-440d-ad00-1768b45b88fd`::Granted request
>Thread-15::DEBUG::2014-08-21 11:24:12,499::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000674 s, 739 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:24:12,503::task::827::TaskManager.Task::(resourceAcquired) Task=`10a4e390-f344-4dd7-b7f8-64fe2a5d7054`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:24:12,503::task::990::TaskManager.Task::(_decref) Task=`10a4e390-f344-4dd7-b7f8-64fe2a5d7054`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:24:12,520::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:12,521::task::1185::TaskManager.Task::(prepare) Task=`10a4e390-f344-4dd7-b7f8-64fe2a5d7054`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:12,521::task::595::TaskManager.Task::(_updateState) Task=`10a4e390-f344-4dd7-b7f8-64fe2a5d7054`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:24:12,521::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:24:12,522::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:24:12,522::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:24:12,522::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:24:12,522::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:24:12,522::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:24:12,523::task::990::TaskManager.Task::(_decref) Task=`10a4e390-f344-4dd7-b7f8-64fe2a5d7054`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:24:14,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:24:14,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0529558 s, 19.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:24:16,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:24:19,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.62592 s, 630 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:24:25,493::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 11:24:25,501::task::595::TaskManager.Task::(_updateState) Task=`064b376a-075f-4c1b-b637-0537ed3f58c6`::moving from state init -> state preparing
>Dummy-33::DEBUG::2014-08-21 11:24:25,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::INFO::2014-08-21 11:24:25,530::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:24:25,531::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:24:25,532::task::1185::TaskManager.Task::(prepare) Task=`064b376a-075f-4c1b-b637-0537ed3f58c6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:24:25,532::task::595::TaskManager.Task::(_updateState) Task=`064b376a-075f-4c1b-b637-0537ed3f58c6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:24:25,532::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:24:25,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:24:25,533::task::990::TaskManager.Task::(_decref) Task=`064b376a-075f-4c1b-b637-0537ed3f58c6`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:24:25,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:24:25,638::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 11:24:25,656::task::595::TaskManager.Task::(_updateState) Task=`9a657847-bc1d-44cd-a8c6-9ab2c1df9a89`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:24:25,660::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:24:25,669::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1fd277c7-e8f1-4e3b-a965-c3405912d84a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:24:25,674::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 11:24:25,675::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00201792 s, 247 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:24:25,693::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:24:25,697::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1fd277c7-e8f1-4e3b-a965-c3405912d84a`::Granted request
>Thread-34::DEBUG::2014-08-21 11:24:25,725::task::827::TaskManager.Task::(resourceAcquired) Task=`9a657847-bc1d-44cd-a8c6-9ab2c1df9a89`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:24:25,740::task::990::TaskManager.Task::(_decref) Task=`9a657847-bc1d-44cd-a8c6-9ab2c1df9a89`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:24:25,996::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:25,997::task::1185::TaskManager.Task::(prepare) Task=`9a657847-bc1d-44cd-a8c6-9ab2c1df9a89`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:25,998::task::595::TaskManager.Task::(_updateState) Task=`9a657847-bc1d-44cd-a8c6-9ab2c1df9a89`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:24:25,999::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:24:26,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:24:26,002::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:24:26,003::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:24:26,004::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:24:26,005::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:24:26,007::task::990::TaskManager.Task::(_decref) Task=`9a657847-bc1d-44cd-a8c6-9ab2c1df9a89`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:24:26,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.509952 s, 2.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:24:28,760::task::595::TaskManager.Task::(_updateState) Task=`89585b68-5a6f-4c8c-aa69-50ef4828e0f5`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:24:28,761::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:24:28,762::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00201792', 'lastCheck': '2.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:24:28,762::task::1185::TaskManager.Task::(prepare) Task=`89585b68-5a6f-4c8c-aa69-50ef4828e0f5`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00201792', 'lastCheck': '2.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:24:28,762::task::595::TaskManager.Task::(_updateState) Task=`89585b68-5a6f-4c8c-aa69-50ef4828e0f5`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:24:28,763::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:24:28,858::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:24:28,858::task::990::TaskManager.Task::(_decref) Task=`89585b68-5a6f-4c8c-aa69-50ef4828e0f5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:24:29,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:24:31,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.92082 s, 533 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:24:33,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:24:33,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.410584 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:24:35,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:24:36,089::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [65f62e0f]
>Thread-26::DEBUG::2014-08-21 11:24:36,102::task::595::TaskManager.Task::(_updateState) Task=`dabec4ed-f31e-419b-b8ce-741380a2ec21`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:24:36,493::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:24:36,510::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:24:36,511::task::1185::TaskManager.Task::(prepare) Task=`dabec4ed-f31e-419b-b8ce-741380a2ec21`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:24:36,511::task::595::TaskManager.Task::(_updateState) Task=`dabec4ed-f31e-419b-b8ce-741380a2ec21`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:24:36,623::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:24:36,708::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 11:24:36,859::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:24:36,904::task::990::TaskManager.Task::(_decref) Task=`dabec4ed-f31e-419b-b8ce-741380a2ec21`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:24:36,984::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00182736 s, 273 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:24:36,996::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [65f62e0f]
>Thread-34::DEBUG::2014-08-21 11:24:37,008::task::595::TaskManager.Task::(_updateState) Task=`0f48dcdd-1aae-414e-b434-b580f1e66be6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:24:37,016::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:24:37,019::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0ee5c5cd-cf7e-41dc-97db-bacf0a8da4bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:24:37,020::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:24:37,020::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:24:37,021::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0ee5c5cd-cf7e-41dc-97db-bacf0a8da4bf`::Granted request
>Thread-34::DEBUG::2014-08-21 11:24:37,022::task::827::TaskManager.Task::(resourceAcquired) Task=`0f48dcdd-1aae-414e-b434-b580f1e66be6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:24:37,023::task::990::TaskManager.Task::(_decref) Task=`0f48dcdd-1aae-414e-b434-b580f1e66be6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:24:37,137::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:37,139::task::1185::TaskManager.Task::(prepare) Task=`0f48dcdd-1aae-414e-b434-b580f1e66be6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:37,141::task::595::TaskManager.Task::(_updateState) Task=`0f48dcdd-1aae-414e-b434-b580f1e66be6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:24:37,142::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:24:37,144::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:24:37,147::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:24:37,161::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:24:37,163::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:24:37,165::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:24:37,168::task::990::TaskManager.Task::(_decref) Task=`0f48dcdd-1aae-414e-b434-b580f1e66be6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:24:37,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.38149 s, 741 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:24:39,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:24:47,077::task::595::TaskManager.Task::(_updateState) Task=`c7cd3ee9-2d72-49b1-b203-29ed767a4b93`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 11:24:47,414::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-13::DEBUG::2014-08-21 11:24:47,431::task::595::TaskManager.Task::(_updateState) Task=`75b48ec0-8f3a-48a2-909f-02bf6a11a7d9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:24:47,551::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-15::DEBUG::2014-08-21 11:24:47,659::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::INFO::2014-08-21 11:24:47,673::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 11:24:48,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00878949 s, 56.7 kB/s\n'; <rc> = 0
>Thread-26::INFO::2014-08-21 11:24:48,512::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182736', 'lastCheck': '11.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:24:48,543::task::1185::TaskManager.Task::(prepare) Task=`c7cd3ee9-2d72-49b1-b203-29ed767a4b93`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182736', 'lastCheck': '11.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:24:48,544::task::595::TaskManager.Task::(_updateState) Task=`c7cd3ee9-2d72-49b1-b203-29ed767a4b93`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:24:48,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:24:48,830::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:24:48,831::task::990::TaskManager.Task::(_decref) Task=`c7cd3ee9-2d72-49b1-b203-29ed767a4b93`::ref 0 aborting False
>Thread-13::INFO::2014-08-21 11:24:48,978::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:24:48,979::task::1185::TaskManager.Task::(prepare) Task=`75b48ec0-8f3a-48a2-909f-02bf6a11a7d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:24:48,979::task::595::TaskManager.Task::(_updateState) Task=`75b48ec0-8f3a-48a2-909f-02bf6a11a7d9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:24:48,985::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:24:48,986::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:24:49,023::task::990::TaskManager.Task::(_decref) Task=`75b48ec0-8f3a-48a2-909f-02bf6a11a7d9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:24:49,432::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-34::DEBUG::2014-08-21 11:24:49,434::task::595::TaskManager.Task::(_updateState) Task=`4ab99369-e78a-40f5-8fd2-acc69696ea37`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:24:49,516::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:24:49,573::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5127bbeb-506f-4e74-863b-0392ffaac85d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:24:49,574::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:24:49,575::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:24:49,588::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5127bbeb-506f-4e74-863b-0392ffaac85d`::Granted request
>Thread-34::DEBUG::2014-08-21 11:24:49,753::task::827::TaskManager.Task::(resourceAcquired) Task=`4ab99369-e78a-40f5-8fd2-acc69696ea37`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:24:49,754::task::990::TaskManager.Task::(_decref) Task=`4ab99369-e78a-40f5-8fd2-acc69696ea37`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:24:49,850::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:49,850::task::1185::TaskManager.Task::(prepare) Task=`4ab99369-e78a-40f5-8fd2-acc69696ea37`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:24:49,851::task::595::TaskManager.Task::(_updateState) Task=`4ab99369-e78a-40f5-8fd2-acc69696ea37`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:24:49,852::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:24:49,852::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:24:49,853::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:24:49,854::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:24:49,854::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:24:49,855::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:24:49,857::task::990::TaskManager.Task::(_decref) Task=`4ab99369-e78a-40f5-8fd2-acc69696ea37`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:24:49,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.3343 s, 99.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:24:53,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:24:56,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.18189 s, 469 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:25:07,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:25:07,647::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-13::DEBUG::2014-08-21 11:25:07,649::task::595::TaskManager.Task::(_updateState) Task=`8c62b520-babb-4451-9e4c-c4f0940d31e5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:25:07,649::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:25:07,655::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:25:07,656::task::1185::TaskManager.Task::(prepare) Task=`8c62b520-babb-4451-9e4c-c4f0940d31e5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:25:07,656::task::595::TaskManager.Task::(_updateState) Task=`8c62b520-babb-4451-9e4c-c4f0940d31e5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:25:07,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:25:07,657::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:25:07,657::task::990::TaskManager.Task::(_decref) Task=`8c62b520-babb-4451-9e4c-c4f0940d31e5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:25:08,319::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-34::DEBUG::2014-08-21 11:25:08,327::task::595::TaskManager.Task::(_updateState) Task=`c9fd2c7d-a26d-42b9-b3d5-1b186cb49b1c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:25:08,334::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:25:08,346::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fa2e40dc-ebc5-47e1-a244-30c30e59926b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:25:08,353::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:25:08,364::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:25:08,370::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fa2e40dc-ebc5-47e1-a244-30c30e59926b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:25:08,386::task::827::TaskManager.Task::(resourceAcquired) Task=`c9fd2c7d-a26d-42b9-b3d5-1b186cb49b1c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:25:08,394::task::990::TaskManager.Task::(_decref) Task=`c9fd2c7d-a26d-42b9-b3d5-1b186cb49b1c`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:25:08,454::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:25:08,459::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:25:08,470::task::1185::TaskManager.Task::(prepare) Task=`c9fd2c7d-a26d-42b9-b3d5-1b186cb49b1c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:25:08,471::task::595::TaskManager.Task::(_updateState) Task=`c9fd2c7d-a26d-42b9-b3d5-1b186cb49b1c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:25:08,471::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:25:08,472::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:25:08,472::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:25:08,473::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:25:08,474::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:25:08,474::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:25:08,475::task::990::TaskManager.Task::(_decref) Task=`c9fd2c7d-a26d-42b9-b3d5-1b186cb49b1c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:25:08,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00565349 s, 88.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:25:08,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.452792 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:25:10,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:25:10,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0563123 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:25:12,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:25:13,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0647022 s, 15.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:25:15,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:25:15,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0684196 s, 15.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:25:17,307::task::595::TaskManager.Task::(_updateState) Task=`a9f84de4-19cd-45a3-bc2e-00474abcf176`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:25:17,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:25:17,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00565349', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:25:17,314::task::1185::TaskManager.Task::(prepare) Task=`a9f84de4-19cd-45a3-bc2e-00474abcf176`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00565349', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:25:17,314::task::595::TaskManager.Task::(_updateState) Task=`a9f84de4-19cd-45a3-bc2e-00474abcf176`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:25:17,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:25:17,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:25:17,315::task::990::TaskManager.Task::(_decref) Task=`a9f84de4-19cd-45a3-bc2e-00474abcf176`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:25:17,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:25:17,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.062806 s, 16.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:25:18,494::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b99cf57]
>Thread-13::DEBUG::2014-08-21 11:25:18,496::task::595::TaskManager.Task::(_updateState) Task=`e58380e3-7da3-4444-9fa8-b0ccece2990c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:25:18,496::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:25:18,497::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:25:18,497::task::1185::TaskManager.Task::(prepare) Task=`e58380e3-7da3-4444-9fa8-b0ccece2990c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:25:18,497::task::595::TaskManager.Task::(_updateState) Task=`e58380e3-7da3-4444-9fa8-b0ccece2990c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:25:18,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:25:18,497::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:25:18,498::task::990::TaskManager.Task::(_decref) Task=`e58380e3-7da3-4444-9fa8-b0ccece2990c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:25:18,504::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b99cf57]
>Thread-34::DEBUG::2014-08-21 11:25:18,504::task::595::TaskManager.Task::(_updateState) Task=`cf35ff7f-bd46-4e75-9420-9fabda9665fd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:25:18,505::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:25:18,505::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`96212f89-8f6a-4be6-8275-dcaf4b3faf66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:25:18,505::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:25:18,506::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:25:18,506::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`96212f89-8f6a-4be6-8275-dcaf4b3faf66`::Granted request
>Thread-34::DEBUG::2014-08-21 11:25:18,506::task::827::TaskManager.Task::(resourceAcquired) Task=`cf35ff7f-bd46-4e75-9420-9fabda9665fd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:25:18,507::task::990::TaskManager.Task::(_decref) Task=`cf35ff7f-bd46-4e75-9420-9fabda9665fd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:25:18,512::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:25:18,513::task::1185::TaskManager.Task::(prepare) Task=`cf35ff7f-bd46-4e75-9420-9fabda9665fd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:25:18,513::task::595::TaskManager.Task::(_updateState) Task=`cf35ff7f-bd46-4e75-9420-9fabda9665fd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:25:18,513::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:25:18,513::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:25:18,514::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:25:18,514::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:25:18,514::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:25:18,514::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:25:18,515::task::990::TaskManager.Task::(_decref) Task=`cf35ff7f-bd46-4e75-9420-9fabda9665fd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:25:18,569::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:25:18,590::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00201023 s, 248 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:25:19,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:25:28,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.525481 s, 1.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:25:28,794::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:25:30,544::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-15::DEBUG::2014-08-21 11:25:30,585::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.455003 s, 1.1 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:25:30,830::task::595::TaskManager.Task::(_updateState) Task=`91a73303-09bb-4d2a-be9b-e198b5a30795`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:25:30,831::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:25:30,832::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:25:30,833::task::1185::TaskManager.Task::(prepare) Task=`91a73303-09bb-4d2a-be9b-e198b5a30795`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:25:30,833::task::595::TaskManager.Task::(_updateState) Task=`91a73303-09bb-4d2a-be9b-e198b5a30795`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:25:30,834::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:25:30,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:25:30,872::task::990::TaskManager.Task::(_decref) Task=`91a73303-09bb-4d2a-be9b-e198b5a30795`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:25:30,952::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-34::DEBUG::2014-08-21 11:25:30,954::task::595::TaskManager.Task::(_updateState) Task=`dcf47012-db75-42e5-a313-02f7e9ef04fc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:25:30,954::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:25:30,955::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`57bbae6a-3ac1-4c33-81da-39d3df4fcb93`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:25:30,956::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:25:30,956::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:25:30,957::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`57bbae6a-3ac1-4c33-81da-39d3df4fcb93`::Granted request
>Thread-34::DEBUG::2014-08-21 11:25:30,959::task::827::TaskManager.Task::(resourceAcquired) Task=`dcf47012-db75-42e5-a313-02f7e9ef04fc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:25:30,960::task::990::TaskManager.Task::(_decref) Task=`dcf47012-db75-42e5-a313-02f7e9ef04fc`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:25:30,967::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:25:30,967::task::1185::TaskManager.Task::(prepare) Task=`dcf47012-db75-42e5-a313-02f7e9ef04fc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:25:30,968::task::595::TaskManager.Task::(_updateState) Task=`dcf47012-db75-42e5-a313-02f7e9ef04fc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:25:30,968::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:25:30,968::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:25:30,969::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:25:30,969::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:25:30,970::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:25:30,970::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:25:30,971::task::990::TaskManager.Task::(_decref) Task=`dcf47012-db75-42e5-a313-02f7e9ef04fc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:25:31,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:25:41,936::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-26::DEBUG::2014-08-21 11:25:42,134::task::595::TaskManager.Task::(_updateState) Task=`3c1b4743-cf37-4e46-bef3-d4d26a39a466`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:25:42,135::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:25:42,140::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:25:42,140::task::1185::TaskManager.Task::(prepare) Task=`3c1b4743-cf37-4e46-bef3-d4d26a39a466`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:25:42,161::task::595::TaskManager.Task::(_updateState) Task=`3c1b4743-cf37-4e46-bef3-d4d26a39a466`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:25:42,162::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:25:42,162::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:25:42,162::task::990::TaskManager.Task::(_decref) Task=`3c1b4743-cf37-4e46-bef3-d4d26a39a466`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:25:42,507::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:25:51,793::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-15::DEBUG::2014-08-21 11:25:52,806::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 2.84696 s, 0.2 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:25:52,839::task::595::TaskManager.Task::(_updateState) Task=`df6f843b-7390-437f-a3c5-7a1ee20f727f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:25:52,894::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:25:52,895::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1810c5a-2b37-4b2b-8135-2b0b1769870d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:25:53,322::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:25:53,548::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:25:53,600::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1810c5a-2b37-4b2b-8135-2b0b1769870d`::Granted request
>Thread-34::DEBUG::2014-08-21 11:25:53,660::task::827::TaskManager.Task::(resourceAcquired) Task=`df6f843b-7390-437f-a3c5-7a1ee20f727f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:25:53,668::task::990::TaskManager.Task::(_decref) Task=`df6f843b-7390-437f-a3c5-7a1ee20f727f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:25:53,968::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:25:53,969::task::1185::TaskManager.Task::(prepare) Task=`df6f843b-7390-437f-a3c5-7a1ee20f727f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:25:53,969::task::595::TaskManager.Task::(_updateState) Task=`df6f843b-7390-437f-a3c5-7a1ee20f727f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:25:53,969::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:25:53,970::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:25:53,970::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:25:53,971::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:25:53,971::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:25:53,978::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:25:53,979::task::990::TaskManager.Task::(_decref) Task=`df6f843b-7390-437f-a3c5-7a1ee20f727f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:25:55,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 23.8065 s, 43.0 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:25:57,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:26:00,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.318967 s, 3.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:26:01,326::task::595::TaskManager.Task::(_updateState) Task=`083df30c-7bd3-4634-91c0-34efb6e3bd5b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:26:01,327::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:26:01,328::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '2.84696', 'lastCheck': '7.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:26:01,329::task::1185::TaskManager.Task::(prepare) Task=`083df30c-7bd3-4634-91c0-34efb6e3bd5b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '2.84696', 'lastCheck': '7.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:26:01,367::task::595::TaskManager.Task::(_updateState) Task=`083df30c-7bd3-4634-91c0-34efb6e3bd5b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:26:01,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:26:01,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:26:01,368::task::990::TaskManager.Task::(_decref) Task=`083df30c-7bd3-4634-91c0-34efb6e3bd5b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:26:02,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:26:03,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.76646 s, 1.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:26:03,440::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:26:03,506::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0202061 s, 24.6 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:26:04,308::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-13::DEBUG::2014-08-21 11:26:04,310::task::595::TaskManager.Task::(_updateState) Task=`aa9fecd4-92f3-4585-b816-57714efdd624`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:26:04,310::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:26:04,340::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:26:04,352::task::1185::TaskManager.Task::(prepare) Task=`aa9fecd4-92f3-4585-b816-57714efdd624`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:26:04,360::task::595::TaskManager.Task::(_updateState) Task=`aa9fecd4-92f3-4585-b816-57714efdd624`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:26:04,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:26:04,372::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:26:04,383::task::990::TaskManager.Task::(_decref) Task=`aa9fecd4-92f3-4585-b816-57714efdd624`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:26:05,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:26:05,600::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-34::DEBUG::2014-08-21 11:26:05,633::task::595::TaskManager.Task::(_updateState) Task=`2dc7f6db-d5a5-4d9d-8807-d5dea24e190d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:26:05,988::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:26:06,016::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7e7cb35f-0852-4c19-a813-7d0c7cad8f88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:26:06,016::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:26:06,019::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:26:06,019::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7e7cb35f-0852-4c19-a813-7d0c7cad8f88`::Granted request
>Thread-34::DEBUG::2014-08-21 11:26:06,020::task::827::TaskManager.Task::(resourceAcquired) Task=`2dc7f6db-d5a5-4d9d-8807-d5dea24e190d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:26:06,020::task::990::TaskManager.Task::(_decref) Task=`2dc7f6db-d5a5-4d9d-8807-d5dea24e190d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:26:06,104::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895080960', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:26:06,105::task::1185::TaskManager.Task::(prepare) Task=`2dc7f6db-d5a5-4d9d-8807-d5dea24e190d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895080960', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:26:06,105::task::595::TaskManager.Task::(_updateState) Task=`2dc7f6db-d5a5-4d9d-8807-d5dea24e190d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:26:06,106::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:26:28,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:26:28,559::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:26:28,620::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:26:28,621::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:26:28,622::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:26:28,623::task::990::TaskManager.Task::(_decref) Task=`2dc7f6db-d5a5-4d9d-8807-d5dea24e190d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:26:29,861::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:26:30,030::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00700696 s, 71.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:26:30,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 24.4708 s, 41.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:26:32,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:26:33,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.342578 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:26:35,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:26:35,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.06608 s, 15.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:26:37,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:26:37,561::task::595::TaskManager.Task::(_updateState) Task=`a5f03b35-4c56-40b4-a9c2-9223b1152513`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:26:37,563::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:26:37,565::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00700696', 'lastCheck': '7.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:26:37,567::task::1185::TaskManager.Task::(prepare) Task=`a5f03b35-4c56-40b4-a9c2-9223b1152513`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00700696', 'lastCheck': '7.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:26:37,570::task::595::TaskManager.Task::(_updateState) Task=`a5f03b35-4c56-40b4-a9c2-9223b1152513`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:26:37,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:26:37,573::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:26:37,575::task::990::TaskManager.Task::(_decref) Task=`a5f03b35-4c56-40b4-a9c2-9223b1152513`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:26:37,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869874 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:26:39,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:26:39,646::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-26::DEBUG::2014-08-21 11:26:39,648::task::595::TaskManager.Task::(_updateState) Task=`6865aeac-2ba7-48b9-85e2-7822b31192d1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:26:39,648::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:26:39,649::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:26:39,649::task::1185::TaskManager.Task::(prepare) Task=`6865aeac-2ba7-48b9-85e2-7822b31192d1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:26:39,649::task::595::TaskManager.Task::(_updateState) Task=`6865aeac-2ba7-48b9-85e2-7822b31192d1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:26:39,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:26:39,650::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:26:39,650::task::990::TaskManager.Task::(_decref) Task=`6865aeac-2ba7-48b9-85e2-7822b31192d1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:26:39,656::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-34::DEBUG::2014-08-21 11:26:39,657::task::595::TaskManager.Task::(_updateState) Task=`feeec0f0-08fd-47b5-adc3-c047d5f190f4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:26:39,657::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:26:39,659::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`13c1d383-7ec7-4de2-b559-a373f1d52e05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:26:39,659::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:26:39,660::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:26:39,661::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`13c1d383-7ec7-4de2-b559-a373f1d52e05`::Granted request
>Thread-34::DEBUG::2014-08-21 11:26:39,661::task::827::TaskManager.Task::(resourceAcquired) Task=`feeec0f0-08fd-47b5-adc3-c047d5f190f4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:26:39,662::task::990::TaskManager.Task::(_decref) Task=`feeec0f0-08fd-47b5-adc3-c047d5f190f4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:26:39,666::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:26:39,666::task::1185::TaskManager.Task::(prepare) Task=`feeec0f0-08fd-47b5-adc3-c047d5f190f4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:26:39,667::task::595::TaskManager.Task::(_updateState) Task=`feeec0f0-08fd-47b5-adc3-c047d5f190f4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:26:39,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:26:39,667::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:26:39,667::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:26:39,667::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:26:39,668::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:26:39,668::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:26:39,668::task::990::TaskManager.Task::(_decref) Task=`feeec0f0-08fd-47b5-adc3-c047d5f190f4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:26:39,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.11615 s, 8.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:26:40,474::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:26:40,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000592772 s, 840 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:26:41,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:26:41,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521364 s, 19.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:26:44,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:26:44,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.070851 s, 14.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:26:54,037::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Dummy-33::DEBUG::2014-08-21 11:26:54,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:26:54,360::task::595::TaskManager.Task::(_updateState) Task=`01312100-0e6f-4bf5-8b89-5857e18a35c5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:26:54,373::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:26:54,385::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:26:54,392::task::1185::TaskManager.Task::(prepare) Task=`01312100-0e6f-4bf5-8b89-5857e18a35c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:26:54,398::task::595::TaskManager.Task::(_updateState) Task=`01312100-0e6f-4bf5-8b89-5857e18a35c5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:26:54,407::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:26:54,411::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:26:54,428::task::990::TaskManager.Task::(_decref) Task=`01312100-0e6f-4bf5-8b89-5857e18a35c5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:26:57,641::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-15::DEBUG::2014-08-21 11:26:57,770::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:26:57,854::task::595::TaskManager.Task::(_updateState) Task=`b261893a-d0d2-43dd-97e7-c98d39511a0b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:26:57,855::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:26:58,333::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`913f18ff-0e4f-4222-8538-cbe66af878e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:26:58,333::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:26:58,334::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:26:58,335::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`913f18ff-0e4f-4222-8538-cbe66af878e7`::Granted request
>Thread-34::DEBUG::2014-08-21 11:26:58,425::task::827::TaskManager.Task::(resourceAcquired) Task=`b261893a-d0d2-43dd-97e7-c98d39511a0b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:26:58,531::task::990::TaskManager.Task::(_decref) Task=`b261893a-d0d2-43dd-97e7-c98d39511a0b`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:26:58,588::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0177826 s, 28.0 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:26:58,748::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:26:59,035::task::1185::TaskManager.Task::(prepare) Task=`b261893a-d0d2-43dd-97e7-c98d39511a0b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:26:59,069::task::595::TaskManager.Task::(_updateState) Task=`b261893a-d0d2-43dd-97e7-c98d39511a0b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:26:59,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:26:59,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:26:59,098::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:26:59,099::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:26:59,104::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:26:59,104::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:26:59,105::task::990::TaskManager.Task::(_decref) Task=`b261893a-d0d2-43dd-97e7-c98d39511a0b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:26:59,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.3707 s, 191 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:27:00,543::task::595::TaskManager.Task::(_updateState) Task=`d65e2149-ec3d-44a8-9f01-c91571be9749`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:27:00,544::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:27:00,544::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0177826', 'lastCheck': '1.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:27:00,544::task::1185::TaskManager.Task::(prepare) Task=`d65e2149-ec3d-44a8-9f01-c91571be9749`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0177826', 'lastCheck': '1.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:27:00,545::task::595::TaskManager.Task::(_updateState) Task=`d65e2149-ec3d-44a8-9f01-c91571be9749`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:27:00,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:27:00,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:27:00,545::task::990::TaskManager.Task::(_decref) Task=`d65e2149-ec3d-44a8-9f01-c91571be9749`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:27:01,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:27:01,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0801505 s, 12.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:27:03,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:27:04,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.053159 s, 19.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:27:06,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:27:06,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0713147 s, 14.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:27:08,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:27:09,726::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-26::DEBUG::2014-08-21 11:27:09,727::task::595::TaskManager.Task::(_updateState) Task=`9fa83d60-921a-4aec-8f02-2e7a87191761`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:27:09,728::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:27:09,729::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:27:09,729::task::1185::TaskManager.Task::(prepare) Task=`9fa83d60-921a-4aec-8f02-2e7a87191761`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:27:09,729::task::595::TaskManager.Task::(_updateState) Task=`9fa83d60-921a-4aec-8f02-2e7a87191761`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:27:09,729::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:27:09,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Dummy-33::DEBUG::2014-08-21 11:27:09,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.814665 s, 1.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:27:09,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:27:10,026::task::990::TaskManager.Task::(_decref) Task=`9fa83d60-921a-4aec-8f02-2e7a87191761`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:27:10,120::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000922068 s, 540 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:27:11,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-34::DEBUG::2014-08-21 11:27:11,459::task::595::TaskManager.Task::(_updateState) Task=`077c81ee-242a-4e85-9a9c-671a51c919bb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:27:11,460::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:27:11,465::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e3acee73-b3fd-49d3-88c3-0edf01db2e14`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:27:11,466::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:27:11,467::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:27:11,467::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e3acee73-b3fd-49d3-88c3-0edf01db2e14`::Granted request
>Thread-34::DEBUG::2014-08-21 11:27:11,521::task::827::TaskManager.Task::(resourceAcquired) Task=`077c81ee-242a-4e85-9a9c-671a51c919bb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:27:11,523::task::990::TaskManager.Task::(_decref) Task=`077c81ee-242a-4e85-9a9c-671a51c919bb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:27:11,531::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:27:11,531::task::1185::TaskManager.Task::(prepare) Task=`077c81ee-242a-4e85-9a9c-671a51c919bb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:27:11,532::task::595::TaskManager.Task::(_updateState) Task=`077c81ee-242a-4e85-9a9c-671a51c919bb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:27:11,532::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:27:11,533::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:27:11,533::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:27:11,534::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:27:11,534::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:27:11,534::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:27:11,535::task::990::TaskManager.Task::(_decref) Task=`077c81ee-242a-4e85-9a9c-671a51c919bb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:27:21,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:27:21,334::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-26::DEBUG::2014-08-21 11:27:21,568::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Thread-26::DEBUG::2014-08-21 11:27:21,606::task::595::TaskManager.Task::(_updateState) Task=`f97bfc05-5eed-4b56-8ada-d71a42dc228a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:27:21,623::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 11:27:21,771::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:27:21,801::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:27:21,867::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 11:27:22,409::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:27:22,470::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:27:22,470::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-26::INFO::2014-08-21 11:27:22,513::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:27:22,567::task::1185::TaskManager.Task::(prepare) Task=`f97bfc05-5eed-4b56-8ada-d71a42dc228a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:27:22,628::task::595::TaskManager.Task::(_updateState) Task=`f97bfc05-5eed-4b56-8ada-d71a42dc228a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:27:22,632::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:27:22,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:27:22,649::task::990::TaskManager.Task::(_decref) Task=`f97bfc05-5eed-4b56-8ada-d71a42dc228a`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:27:22,865::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:27:28,458::task::595::TaskManager.Task::(_updateState) Task=`1d02b40f-8941-4549-94f7-40566344b795`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 11:27:28,627::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000675081 s, 738 kB/s\n'; <rc> = 0
>Thread-13::INFO::2014-08-21 11:27:28,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:27:28,795::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000922068', 'lastCheck': '18.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:27:28,795::task::1185::TaskManager.Task::(prepare) Task=`1d02b40f-8941-4549-94f7-40566344b795`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000922068', 'lastCheck': '18.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:27:28,796::task::595::TaskManager.Task::(_updateState) Task=`1d02b40f-8941-4549-94f7-40566344b795`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:27:28,885::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Thread-34::DEBUG::2014-08-21 11:27:28,887::task::595::TaskManager.Task::(_updateState) Task=`e852eaa7-b20f-48c2-b010-cd42f5a8bc47`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:27:28,915::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:27:28,917::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6bb9cccb-2974-4517-bb2f-e3b1261a408b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:27:28,917::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-13::DEBUG::2014-08-21 11:27:29,165::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:27:29,188::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:27:29,228::task::990::TaskManager.Task::(_decref) Task=`1d02b40f-8941-4549-94f7-40566344b795`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:27:29,248::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:27:29,249::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6bb9cccb-2974-4517-bb2f-e3b1261a408b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:27:29,274::task::827::TaskManager.Task::(resourceAcquired) Task=`e852eaa7-b20f-48c2-b010-cd42f5a8bc47`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:27:29,275::task::990::TaskManager.Task::(_decref) Task=`e852eaa7-b20f-48c2-b010-cd42f5a8bc47`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:27:29,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:27:29,363::task::1185::TaskManager.Task::(prepare) Task=`e852eaa7-b20f-48c2-b010-cd42f5a8bc47`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:27:29,364::task::595::TaskManager.Task::(_updateState) Task=`e852eaa7-b20f-48c2-b010-cd42f5a8bc47`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:27:29,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:27:29,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:27:29,366::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:27:29,367::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:27:29,367::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:27:29,367::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:27:29,368::task::990::TaskManager.Task::(_decref) Task=`e852eaa7-b20f-48c2-b010-cd42f5a8bc47`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:27:29,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.68752 s, 133 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:27:33,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:27:35,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.76172 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:27:37,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:27:38,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.285094 s, 3.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:27:39,181::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:27:39,198::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000419819 s, 1.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:27:44,502::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-13::DEBUG::2014-08-21 11:27:44,529::task::595::TaskManager.Task::(_updateState) Task=`a87cf764-44da-4f9e-a7af-77fd9b2eb6af`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:27:44,545::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 11:27:44,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::INFO::2014-08-21 11:27:44,575::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:27:44,583::task::1185::TaskManager.Task::(prepare) Task=`a87cf764-44da-4f9e-a7af-77fd9b2eb6af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:27:44,588::task::595::TaskManager.Task::(_updateState) Task=`a87cf764-44da-4f9e-a7af-77fd9b2eb6af`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:27:44,589::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:27:44,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:27:44,589::task::990::TaskManager.Task::(_decref) Task=`a87cf764-44da-4f9e-a7af-77fd9b2eb6af`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:27:45,807::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-34::DEBUG::2014-08-21 11:27:45,999::task::595::TaskManager.Task::(_updateState) Task=`9de63b13-d049-4c02-a7dd-eeab583f06c3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:27:46,000::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:27:46,001::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2c8d1573-b9b5-4065-9dab-406e12a44ba7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:27:46,001::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:27:46,002::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:27:46,008::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2c8d1573-b9b5-4065-9dab-406e12a44ba7`::Granted request
>Thread-34::DEBUG::2014-08-21 11:27:46,008::task::827::TaskManager.Task::(resourceAcquired) Task=`9de63b13-d049-4c02-a7dd-eeab583f06c3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:27:46,009::task::990::TaskManager.Task::(_decref) Task=`9de63b13-d049-4c02-a7dd-eeab583f06c3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:27:46,027::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:27:46,028::task::1185::TaskManager.Task::(prepare) Task=`9de63b13-d049-4c02-a7dd-eeab583f06c3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:27:46,033::task::595::TaskManager.Task::(_updateState) Task=`9de63b13-d049-4c02-a7dd-eeab583f06c3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:27:46,033::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:27:46,033::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:27:46,034::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:27:46,034::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:27:46,042::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:27:46,043::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:27:46,043::task::990::TaskManager.Task::(_decref) Task=`9de63b13-d049-4c02-a7dd-eeab583f06c3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:27:48,608::task::595::TaskManager.Task::(_updateState) Task=`6bda53ad-f92f-4d1c-acd7-4d24d8330743`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:27:48,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:27:48,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419819', 'lastCheck': '9.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:27:48,624::task::1185::TaskManager.Task::(prepare) Task=`6bda53ad-f92f-4d1c-acd7-4d24d8330743`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419819', 'lastCheck': '9.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:27:48,624::task::595::TaskManager.Task::(_updateState) Task=`6bda53ad-f92f-4d1c-acd7-4d24d8330743`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:27:49,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:27:49,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:27:49,288::task::990::TaskManager.Task::(_decref) Task=`6bda53ad-f92f-4d1c-acd7-4d24d8330743`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:27:54,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:27:56,962::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0300747 s, 16.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:27:58,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 12.6762 s, 80.8 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:27:58,879::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-13::DEBUG::2014-08-21 11:27:58,880::task::595::TaskManager.Task::(_updateState) Task=`c0b2a13d-48d3-43ee-9442-05eb3e62075c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:27:58,881::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:27:58,882::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:27:58,882::task::1185::TaskManager.Task::(prepare) Task=`c0b2a13d-48d3-43ee-9442-05eb3e62075c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:27:58,883::task::595::TaskManager.Task::(_updateState) Task=`c0b2a13d-48d3-43ee-9442-05eb3e62075c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:27:58,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:27:58,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:27:58,884::task::990::TaskManager.Task::(_decref) Task=`c0b2a13d-48d3-43ee-9442-05eb3e62075c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:27:58,891::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6dc8f0bb]
>Thread-34::DEBUG::2014-08-21 11:27:58,892::task::595::TaskManager.Task::(_updateState) Task=`96131dbb-37b1-4838-91b5-4c2296d03ea6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:27:58,893::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:27:58,893::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`452e3f38-6ff6-4003-ad9f-7a6ca774fefb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:27:58,894::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:27:58,894::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:27:58,895::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`452e3f38-6ff6-4003-ad9f-7a6ca774fefb`::Granted request
>Thread-34::DEBUG::2014-08-21 11:27:58,895::task::827::TaskManager.Task::(resourceAcquired) Task=`96131dbb-37b1-4838-91b5-4c2296d03ea6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:27:58,896::task::990::TaskManager.Task::(_decref) Task=`96131dbb-37b1-4838-91b5-4c2296d03ea6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:27:58,902::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:27:58,903::task::1185::TaskManager.Task::(prepare) Task=`96131dbb-37b1-4838-91b5-4c2296d03ea6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:27:58,903::task::595::TaskManager.Task::(_updateState) Task=`96131dbb-37b1-4838-91b5-4c2296d03ea6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:27:58,903::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:27:58,904::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:27:58,904::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:27:58,904::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:27:58,905::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:27:58,905::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:27:58,905::task::990::TaskManager.Task::(_decref) Task=`96131dbb-37b1-4838-91b5-4c2296d03ea6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:28:00,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:05,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.84451 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:07,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:07,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.13507 s, 7.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:28:07,774::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:28:07,796::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000814766 s, 611 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:28:08,929::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-13::DEBUG::2014-08-21 11:28:08,931::task::595::TaskManager.Task::(_updateState) Task=`d07842f0-fa19-461b-bc57-cf21803fe3d8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:28:08,931::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:28:08,932::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:28:08,932::task::1185::TaskManager.Task::(prepare) Task=`d07842f0-fa19-461b-bc57-cf21803fe3d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:28:08,932::task::595::TaskManager.Task::(_updateState) Task=`d07842f0-fa19-461b-bc57-cf21803fe3d8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:28:08,933::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:28:08,933::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:28:08,933::task::990::TaskManager.Task::(_decref) Task=`d07842f0-fa19-461b-bc57-cf21803fe3d8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:28:08,943::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-34::DEBUG::2014-08-21 11:28:08,944::task::595::TaskManager.Task::(_updateState) Task=`7330e423-0f29-4791-8e99-40b612271dbe`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:28:08,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:28:08,945::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f8d543a8-2853-45b6-9538-8ad3fb7d7109`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:28:08,945::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:28:08,946::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:28:08,946::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f8d543a8-2853-45b6-9538-8ad3fb7d7109`::Granted request
>Thread-34::DEBUG::2014-08-21 11:28:08,947::task::827::TaskManager.Task::(resourceAcquired) Task=`7330e423-0f29-4791-8e99-40b612271dbe`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:28:08,947::task::990::TaskManager.Task::(_decref) Task=`7330e423-0f29-4791-8e99-40b612271dbe`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:28:08,955::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:08,955::task::1185::TaskManager.Task::(prepare) Task=`7330e423-0f29-4791-8e99-40b612271dbe`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:08,956::task::595::TaskManager.Task::(_updateState) Task=`7330e423-0f29-4791-8e99-40b612271dbe`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:28:08,956::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:28:08,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:28:08,957::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:28:08,957::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:28:08,958::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:28:08,958::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:28:08,959::task::990::TaskManager.Task::(_decref) Task=`7330e423-0f29-4791-8e99-40b612271dbe`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:28:09,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:10,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.815128 s, 1.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:28:11,381::task::595::TaskManager.Task::(_updateState) Task=`0df1ce97-618a-4516-90dd-3edd3f1a9212`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:28:11,383::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:28:11,385::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814766', 'lastCheck': '3.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:28:11,386::task::1185::TaskManager.Task::(prepare) Task=`0df1ce97-618a-4516-90dd-3edd3f1a9212`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814766', 'lastCheck': '3.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:28:11,387::task::595::TaskManager.Task::(_updateState) Task=`0df1ce97-618a-4516-90dd-3edd3f1a9212`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:28:11,388::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:28:11,389::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:28:11,390::task::990::TaskManager.Task::(_decref) Task=`0df1ce97-618a-4516-90dd-3edd3f1a9212`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:28:12,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:13,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0995473 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:15,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:15,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178307 s, 5.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:17,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:17,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896079 s, 11.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:28:17,819::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:28:17,837::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00129742 s, 384 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:28:18,978::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 11:28:18,979::task::595::TaskManager.Task::(_updateState) Task=`f416a861-843a-4655-9427-9d1272c564b8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:28:18,979::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:28:18,980::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:28:18,980::task::1185::TaskManager.Task::(prepare) Task=`f416a861-843a-4655-9427-9d1272c564b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:28:18,980::task::595::TaskManager.Task::(_updateState) Task=`f416a861-843a-4655-9427-9d1272c564b8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:28:18,980::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:28:18,980::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:28:18,981::task::990::TaskManager.Task::(_decref) Task=`f416a861-843a-4655-9427-9d1272c564b8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:28:18,986::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 11:28:18,987::task::595::TaskManager.Task::(_updateState) Task=`19005074-ee7a-45d2-b7a2-d42422b96ca4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:28:18,987::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:28:18,988::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ab0ad622-c5b8-40a2-b459-1fdfc96d788e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:28:18,988::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:28:18,989::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:28:18,989::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ab0ad622-c5b8-40a2-b459-1fdfc96d788e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:28:18,990::task::827::TaskManager.Task::(resourceAcquired) Task=`19005074-ee7a-45d2-b7a2-d42422b96ca4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:28:18,990::task::990::TaskManager.Task::(_decref) Task=`19005074-ee7a-45d2-b7a2-d42422b96ca4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:28:18,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:18,998::task::1185::TaskManager.Task::(prepare) Task=`19005074-ee7a-45d2-b7a2-d42422b96ca4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:18,998::task::595::TaskManager.Task::(_updateState) Task=`19005074-ee7a-45d2-b7a2-d42422b96ca4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:28:18,999::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:28:18,999::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:28:19,000::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:28:19,000::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:28:19,000::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:28:19,001::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:28:19,001::task::990::TaskManager.Task::(_decref) Task=`19005074-ee7a-45d2-b7a2-d42422b96ca4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:28:19,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:19,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0787112 s, 13.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:21,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:28:29,970::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-26::DEBUG::2014-08-21 11:28:29,979::task::595::TaskManager.Task::(_updateState) Task=`2c50d54d-902d-4d88-b466-86eac5276d85`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:28:29,982::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:28:29,985::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:28:29,985::task::1185::TaskManager.Task::(prepare) Task=`2c50d54d-902d-4d88-b466-86eac5276d85`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:28:29,987::task::595::TaskManager.Task::(_updateState) Task=`2c50d54d-902d-4d88-b466-86eac5276d85`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:28:29,988::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:28:29,988::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:28:29,989::task::990::TaskManager.Task::(_decref) Task=`2c50d54d-902d-4d88-b466-86eac5276d85`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:28:32,055::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-34::DEBUG::2014-08-21 11:28:32,066::task::595::TaskManager.Task::(_updateState) Task=`f3687a10-d55c-42fe-8319-0534b692355f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:28:32,087::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:28:32,100::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a078b2f1-8107-4857-9640-91982873b739`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:28:32,109::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:28:32,124::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:28:32,132::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a078b2f1-8107-4857-9640-91982873b739`::Granted request
>Thread-34::DEBUG::2014-08-21 11:28:32,146::task::827::TaskManager.Task::(resourceAcquired) Task=`f3687a10-d55c-42fe-8319-0534b692355f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:28:32,146::task::990::TaskManager.Task::(_decref) Task=`f3687a10-d55c-42fe-8319-0534b692355f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:28:32,203::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:32,208::task::1185::TaskManager.Task::(prepare) Task=`f3687a10-d55c-42fe-8319-0534b692355f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:32,214::task::595::TaskManager.Task::(_updateState) Task=`f3687a10-d55c-42fe-8319-0534b692355f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:28:32,220::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:28:32,226::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:28:32,238::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:28:32,244::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:28:32,247::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:28:32,249::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-15::DEBUG::2014-08-21 11:28:32,254::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:28:32,254::task::990::TaskManager.Task::(_decref) Task=`f3687a10-d55c-42fe-8319-0534b692355f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:28:32,321::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00136142 s, 366 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:32,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 9.3408 s, 110 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:34,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:28:35,259::task::595::TaskManager.Task::(_updateState) Task=`f1886d4b-81b4-4bbf-837b-c1bf5b5f8201`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:28:35,544::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:28:35,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129742', 'lastCheck': '17.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:28:35,545::task::1185::TaskManager.Task::(prepare) Task=`f1886d4b-81b4-4bbf-837b-c1bf5b5f8201`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129742', 'lastCheck': '17.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:28:35,545::task::595::TaskManager.Task::(_updateState) Task=`f1886d4b-81b4-4bbf-837b-c1bf5b5f8201`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:28:35,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:28:35,593::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:28:35,594::task::990::TaskManager.Task::(_decref) Task=`f1886d4b-81b4-4bbf-837b-c1bf5b5f8201`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:28:37,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.35388 s, 435 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:39,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:40,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.12154 s, 8.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:42,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:42,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0997159 s, 10.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:28:42,300::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b99cf57]
>Thread-26::DEBUG::2014-08-21 11:28:42,304::task::595::TaskManager.Task::(_updateState) Task=`88478b2a-551b-499b-b79b-9476a8be5098`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:28:42,306::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:28:42,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:28:42,309::task::1185::TaskManager.Task::(prepare) Task=`88478b2a-551b-499b-b79b-9476a8be5098`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:28:42,311::task::595::TaskManager.Task::(_updateState) Task=`88478b2a-551b-499b-b79b-9476a8be5098`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:28:42,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:28:42,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:28:42,314::task::990::TaskManager.Task::(_decref) Task=`88478b2a-551b-499b-b79b-9476a8be5098`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:28:42,325::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b99cf57]
>Thread-34::DEBUG::2014-08-21 11:28:42,327::task::595::TaskManager.Task::(_updateState) Task=`11f07e42-6fc2-4f53-a77a-1b8f5abbcf77`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:28:42,329::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:28:42,331::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f6cf1c5e-7faa-4b09-acb8-bbb5d1d699a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:28:42,332::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:28:42,333::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:28:42,334::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f6cf1c5e-7faa-4b09-acb8-bbb5d1d699a0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:28:42,336::task::827::TaskManager.Task::(resourceAcquired) Task=`11f07e42-6fc2-4f53-a77a-1b8f5abbcf77`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:28:42,337::task::990::TaskManager.Task::(_decref) Task=`11f07e42-6fc2-4f53-a77a-1b8f5abbcf77`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:28:42,352::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:42,353::task::1185::TaskManager.Task::(prepare) Task=`11f07e42-6fc2-4f53-a77a-1b8f5abbcf77`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:42,354::task::595::TaskManager.Task::(_updateState) Task=`11f07e42-6fc2-4f53-a77a-1b8f5abbcf77`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:28:42,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:28:42,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:28:42,358::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:28:42,359::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:28:42,360::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:28:42,360::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:28:42,361::task::990::TaskManager.Task::(_decref) Task=`11f07e42-6fc2-4f53-a77a-1b8f5abbcf77`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:28:44,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:44,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0695536 s, 14.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:28:45,603::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:28:45,625::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00227261 s, 219 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:46,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:28:50,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.42743 s, 422 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:28:52,069::task::595::TaskManager.Task::(_updateState) Task=`e269a336-ef1e-4d7e-b0b1-440c4f5ad254`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:28:52,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:28:52,070::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00227261', 'lastCheck': '6.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:28:52,070::task::1185::TaskManager.Task::(prepare) Task=`e269a336-ef1e-4d7e-b0b1-440c4f5ad254`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00227261', 'lastCheck': '6.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:28:52,071::task::595::TaskManager.Task::(_updateState) Task=`e269a336-ef1e-4d7e-b0b1-440c4f5ad254`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:28:52,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:28:52,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:28:52,071::task::990::TaskManager.Task::(_decref) Task=`e269a336-ef1e-4d7e-b0b1-440c4f5ad254`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:28:54,325::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Thread-13::DEBUG::2014-08-21 11:28:54,354::task::595::TaskManager.Task::(_updateState) Task=`fd6e4427-4849-4eb9-997a-a3b40a844541`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:28:54,355::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 11:28:54,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::INFO::2014-08-21 11:28:54,629::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:28:54,632::task::1185::TaskManager.Task::(prepare) Task=`fd6e4427-4849-4eb9-997a-a3b40a844541`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:28:54,633::task::595::TaskManager.Task::(_updateState) Task=`fd6e4427-4849-4eb9-997a-a3b40a844541`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:28:54,634::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:28:54,635::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:28:54,637::task::990::TaskManager.Task::(_decref) Task=`fd6e4427-4849-4eb9-997a-a3b40a844541`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:28:57,107::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Thread-34::DEBUG::2014-08-21 11:28:57,114::task::595::TaskManager.Task::(_updateState) Task=`673eedff-84c7-4b83-b5ba-8ee4094ca755`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:28:57,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:28:57,120::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`01863107-03b3-42fb-9be2-7214b43661f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:28:57,121::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:28:57,123::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:28:57,124::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`01863107-03b3-42fb-9be2-7214b43661f1`::Granted request
>Thread-34::DEBUG::2014-08-21 11:28:57,132::task::827::TaskManager.Task::(resourceAcquired) Task=`673eedff-84c7-4b83-b5ba-8ee4094ca755`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:28:57,145::task::990::TaskManager.Task::(_decref) Task=`673eedff-84c7-4b83-b5ba-8ee4094ca755`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:28:57,166::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:57,167::task::1185::TaskManager.Task::(prepare) Task=`673eedff-84c7-4b83-b5ba-8ee4094ca755`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:28:57,167::task::595::TaskManager.Task::(_updateState) Task=`673eedff-84c7-4b83-b5ba-8ee4094ca755`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:28:57,167::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:28:57,167::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:28:57,168::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:28:57,168::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:28:57,169::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:28:57,169::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:28:57,169::task::990::TaskManager.Task::(_decref) Task=`673eedff-84c7-4b83-b5ba-8ee4094ca755`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:28:57,887::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:28:58,317::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00538297 s, 92.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:28:59,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.65486 s, 220 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:01,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:01,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0565367 s, 18.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:03,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:04,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.223513 s, 4.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:06,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:06,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.064411 s, 15.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:29:07,418::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-13::DEBUG::2014-08-21 11:29:07,419::task::595::TaskManager.Task::(_updateState) Task=`5fc6193b-e6ea-4c57-9474-d65646ac0889`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:29:07,420::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:29:07,421::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:29:07,421::task::1185::TaskManager.Task::(prepare) Task=`5fc6193b-e6ea-4c57-9474-d65646ac0889`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:29:07,421::task::595::TaskManager.Task::(_updateState) Task=`5fc6193b-e6ea-4c57-9474-d65646ac0889`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:29:07,422::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:29:07,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:29:07,422::task::990::TaskManager.Task::(_decref) Task=`5fc6193b-e6ea-4c57-9474-d65646ac0889`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:29:07,430::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-34::DEBUG::2014-08-21 11:29:07,431::task::595::TaskManager.Task::(_updateState) Task=`252d33b8-39d5-4f1a-a74e-5aca0d470e53`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:29:07,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:29:07,432::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ba435c19-5952-4d67-be47-b1825bc2fdd2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:29:07,433::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:29:07,433::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:29:07,433::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ba435c19-5952-4d67-be47-b1825bc2fdd2`::Granted request
>Thread-34::DEBUG::2014-08-21 11:29:07,434::task::827::TaskManager.Task::(resourceAcquired) Task=`252d33b8-39d5-4f1a-a74e-5aca0d470e53`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:29:07,434::task::990::TaskManager.Task::(_decref) Task=`252d33b8-39d5-4f1a-a74e-5aca0d470e53`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:29:07,439::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:07,440::task::1185::TaskManager.Task::(prepare) Task=`252d33b8-39d5-4f1a-a74e-5aca0d470e53`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:07,440::task::595::TaskManager.Task::(_updateState) Task=`252d33b8-39d5-4f1a-a74e-5aca0d470e53`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:29:07,440::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:29:07,441::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:29:07,441::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:29:07,442::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:29:07,442::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:29:07,442::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:29:07,442::task::990::TaskManager.Task::(_decref) Task=`252d33b8-39d5-4f1a-a74e-5aca0d470e53`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:29:10,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:29:10,893::task::595::TaskManager.Task::(_updateState) Task=`209a3e2a-a206-40d5-9b5e-6197e2889675`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:29:10,897::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:29:10,898::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00538297', 'lastCheck': '11.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:29:10,898::task::1185::TaskManager.Task::(prepare) Task=`209a3e2a-a206-40d5-9b5e-6197e2889675`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00538297', 'lastCheck': '11.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:29:10,899::task::595::TaskManager.Task::(_updateState) Task=`209a3e2a-a206-40d5-9b5e-6197e2889675`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:29:10,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:29:10,899::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:29:10,900::task::990::TaskManager.Task::(_decref) Task=`209a3e2a-a206-40d5-9b5e-6197e2889675`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:29:18,438::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-15::DEBUG::2014-08-21 11:29:18,449::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:29:18,477::task::595::TaskManager.Task::(_updateState) Task=`70ff7ab1-d507-4dc4-9177-4d3de921b499`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 11:29:18,612::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00307874 s, 162 kB/s\n'; <rc> = 0
>Thread-13::INFO::2014-08-21 11:29:18,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:29:18,695::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:29:18,704::task::1185::TaskManager.Task::(prepare) Task=`70ff7ab1-d507-4dc4-9177-4d3de921b499`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:29:18,737::task::595::TaskManager.Task::(_updateState) Task=`70ff7ab1-d507-4dc4-9177-4d3de921b499`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:29:18,763::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:29:18,827::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:29:18,830::task::990::TaskManager.Task::(_decref) Task=`70ff7ab1-d507-4dc4-9177-4d3de921b499`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:29:18,874::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 11:29:18,878::task::595::TaskManager.Task::(_updateState) Task=`f8b952da-2c9e-4ff3-8d49-89942076da56`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:29:18,882::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:29:18,890::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`79dc06be-0c32-4e15-8d16-a09328a0088e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:29:18,893::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:29:18,897::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:29:18,899::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`79dc06be-0c32-4e15-8d16-a09328a0088e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:29:18,905::task::827::TaskManager.Task::(resourceAcquired) Task=`f8b952da-2c9e-4ff3-8d49-89942076da56`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:29:18,908::task::990::TaskManager.Task::(_decref) Task=`f8b952da-2c9e-4ff3-8d49-89942076da56`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:29:18,975::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:18,979::task::1185::TaskManager.Task::(prepare) Task=`f8b952da-2c9e-4ff3-8d49-89942076da56`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:18,982::task::595::TaskManager.Task::(_updateState) Task=`f8b952da-2c9e-4ff3-8d49-89942076da56`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:29:18,985::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:29:18,988::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:29:18,993::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:29:18,998::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:29:19,001::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:29:19,004::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:29:19,008::task::990::TaskManager.Task::(_decref) Task=`f8b952da-2c9e-4ff3-8d49-89942076da56`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:29:19,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.30875 s, 123 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:21,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:22,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.567298 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:24,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:24,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.160114 s, 6.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:26,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:26,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100184 s, 10.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:29:29,489::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-13::DEBUG::2014-08-21 11:29:29,493::task::595::TaskManager.Task::(_updateState) Task=`068c16cd-c716-43bc-ac1e-27e7b6285b5f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:29:29,495::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:29:29,496::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Dummy-33::DEBUG::2014-08-21 11:29:29,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:29:29,546::task::1185::TaskManager.Task::(prepare) Task=`068c16cd-c716-43bc-ac1e-27e7b6285b5f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:29:29,573::task::595::TaskManager.Task::(_updateState) Task=`068c16cd-c716-43bc-ac1e-27e7b6285b5f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:29:29,587::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:29:29,604::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:29:29,612::task::990::TaskManager.Task::(_decref) Task=`068c16cd-c716-43bc-ac1e-27e7b6285b5f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:29:29,670::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-34::DEBUG::2014-08-21 11:29:29,684::task::595::TaskManager.Task::(_updateState) Task=`a4a9d8d9-bdc5-4816-b522-21ba6dc3d10a`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:29:29,693::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:29:29,704::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b9cf1d84-872e-4f3b-819d-d57e5a9e0928`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:29:29,708::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:29:29,712::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:29:29,715::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b9cf1d84-872e-4f3b-819d-d57e5a9e0928`::Granted request
>Thread-34::DEBUG::2014-08-21 11:29:29,722::task::827::TaskManager.Task::(resourceAcquired) Task=`a4a9d8d9-bdc5-4816-b522-21ba6dc3d10a`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:29:29,726::task::990::TaskManager.Task::(_decref) Task=`a4a9d8d9-bdc5-4816-b522-21ba6dc3d10a`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:29:29,743::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:29:29,784::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:29,787::task::1185::TaskManager.Task::(prepare) Task=`a4a9d8d9-bdc5-4816-b522-21ba6dc3d10a`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:29,790::task::595::TaskManager.Task::(_updateState) Task=`a4a9d8d9-bdc5-4816-b522-21ba6dc3d10a`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 11:29:29,791::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00243531 s, 204 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:29:29,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:29:29,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:29:29,799::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:29:29,807::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:29:29,810::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:29:29,812::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:29:29,819::task::990::TaskManager.Task::(_decref) Task=`a4a9d8d9-bdc5-4816-b522-21ba6dc3d10a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:29:30,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.466408 s, 2.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:32,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:32,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102952 s, 9.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:29:32,494::task::595::TaskManager.Task::(_updateState) Task=`02720611-f9bc-458a-a35b-f8e8b89044fc`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:29:32,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:29:32,495::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00243531', 'lastCheck': '2.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:29:32,495::task::1185::TaskManager.Task::(prepare) Task=`02720611-f9bc-458a-a35b-f8e8b89044fc`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00243531', 'lastCheck': '2.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:29:32,495::task::595::TaskManager.Task::(_updateState) Task=`02720611-f9bc-458a-a35b-f8e8b89044fc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:29:32,496::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:29:32,496::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:29:32,496::task::990::TaskManager.Task::(_decref) Task=`02720611-f9bc-458a-a35b-f8e8b89044fc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:29:34,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:34,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.256916 s, 4.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:36,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:37,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.254356 s, 4.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:39,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:39,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.160509 s, 6.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:29:40,329::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-13::DEBUG::2014-08-21 11:29:40,331::task::595::TaskManager.Task::(_updateState) Task=`9d6c00d5-f0ce-45c7-bc07-a1c613b27ca1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:29:40,339::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:29:40,341::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:29:40,341::task::1185::TaskManager.Task::(prepare) Task=`9d6c00d5-f0ce-45c7-bc07-a1c613b27ca1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:29:40,342::task::595::TaskManager.Task::(_updateState) Task=`9d6c00d5-f0ce-45c7-bc07-a1c613b27ca1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:29:40,342::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:29:40,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:29:40,344::task::990::TaskManager.Task::(_decref) Task=`9d6c00d5-f0ce-45c7-bc07-a1c613b27ca1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:29:40,654::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 11:29:40,656::task::595::TaskManager.Task::(_updateState) Task=`0a5d9d93-31fc-4803-b78b-73954ecd1497`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:29:40,656::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 11:29:40,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:29:40,900::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d4b1d589-6eb2-475d-b314-111a847acd52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:29:40,901::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Dummy-33::DEBUG::2014-08-21 11:29:41,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:29:41,559::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:29:41,749::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d4b1d589-6eb2-475d-b314-111a847acd52`::Granted request
>Thread-34::DEBUG::2014-08-21 11:29:41,776::task::827::TaskManager.Task::(resourceAcquired) Task=`0a5d9d93-31fc-4803-b78b-73954ecd1497`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:29:41,783::task::990::TaskManager.Task::(_decref) Task=`0a5d9d93-31fc-4803-b78b-73954ecd1497`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:29:41,799::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000818414 s, 608 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:29:41,881::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:41,884::task::1185::TaskManager.Task::(prepare) Task=`0a5d9d93-31fc-4803-b78b-73954ecd1497`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:41,886::task::595::TaskManager.Task::(_updateState) Task=`0a5d9d93-31fc-4803-b78b-73954ecd1497`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:29:41,888::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:29:41,891::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:29:41,896::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:29:41,899::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:29:41,901::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:29:41,903::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:29:41,905::task::990::TaskManager.Task::(_decref) Task=`0a5d9d93-31fc-4803-b78b-73954ecd1497`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:29:42,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.308697 s, 3.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:44,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:44,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.18168 s, 5.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:46,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:47,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.559974 s, 1.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:29:48,455::task::595::TaskManager.Task::(_updateState) Task=`fafc4fbf-4778-434c-aa23-452fdea45052`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:29:48,456::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:29:48,457::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818414', 'lastCheck': '6.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:29:48,457::task::1185::TaskManager.Task::(prepare) Task=`fafc4fbf-4778-434c-aa23-452fdea45052`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818414', 'lastCheck': '6.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:29:48,457::task::595::TaskManager.Task::(_updateState) Task=`fafc4fbf-4778-434c-aa23-452fdea45052`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:29:48,458::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:29:48,458::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:29:48,458::task::990::TaskManager.Task::(_decref) Task=`fafc4fbf-4778-434c-aa23-452fdea45052`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:29:49,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:49,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100066 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:51,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:29:52,043::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-13::DEBUG::2014-08-21 11:29:52,046::task::595::TaskManager.Task::(_updateState) Task=`ec5e2876-1c5f-4a36-a72a-ffe75c51d716`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:29:52,047::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:29:52,057::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:29:52,058::task::1185::TaskManager.Task::(prepare) Task=`ec5e2876-1c5f-4a36-a72a-ffe75c51d716`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:29:52,058::task::595::TaskManager.Task::(_updateState) Task=`ec5e2876-1c5f-4a36-a72a-ffe75c51d716`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:29:52,059::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:29:52,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:29:52,060::task::990::TaskManager.Task::(_decref) Task=`ec5e2876-1c5f-4a36-a72a-ffe75c51d716`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:29:52,382::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-34::DEBUG::2014-08-21 11:29:52,383::task::595::TaskManager.Task::(_updateState) Task=`27f055ce-997a-4a3b-9338-0a3dbb5fad4d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:29:52,388::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:29:52,395::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b2424d82-4ba5-4016-9ca2-9b2999a3264b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:29:52,396::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:29:52,912::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:29:52,913::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b2424d82-4ba5-4016-9ca2-9b2999a3264b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:29:52,938::task::827::TaskManager.Task::(resourceAcquired) Task=`27f055ce-997a-4a3b-9338-0a3dbb5fad4d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:29:52,939::task::990::TaskManager.Task::(_decref) Task=`27f055ce-997a-4a3b-9338-0a3dbb5fad4d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:29:53,210::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:53,217::task::1185::TaskManager.Task::(prepare) Task=`27f055ce-997a-4a3b-9338-0a3dbb5fad4d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:29:53,223::task::595::TaskManager.Task::(_updateState) Task=`27f055ce-997a-4a3b-9338-0a3dbb5fad4d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:29:53,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:29:53,237::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 11:29:53,245::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:29:53,249::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:29:53,302::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:29:53,314::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:29:53,326::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:29:53,333::task::990::TaskManager.Task::(_decref) Task=`27f055ce-997a-4a3b-9338-0a3dbb5fad4d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:29:53,342::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00117948 s, 422 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:53,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0647623 s, 15.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:55,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:55,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.291292 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:29:57,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:29:58,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.764368 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:00,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:02,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.27934 s, 800 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:30:03,361::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 11:30:03,363::task::595::TaskManager.Task::(_updateState) Task=`462ab1b6-bc1c-44e8-a944-49b4c52fb610`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:30:03,364::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:30:03,365::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:30:03,365::task::1185::TaskManager.Task::(prepare) Task=`462ab1b6-bc1c-44e8-a944-49b4c52fb610`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:30:03,365::task::595::TaskManager.Task::(_updateState) Task=`462ab1b6-bc1c-44e8-a944-49b4c52fb610`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:30:03,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:30:03,366::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:30:03,367::task::990::TaskManager.Task::(_decref) Task=`462ab1b6-bc1c-44e8-a944-49b4c52fb610`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:30:03,379::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 11:30:03,382::task::595::TaskManager.Task::(_updateState) Task=`da652e0e-5b94-4b85-89a8-a3a306caeba6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:30:03,386::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:30:03,392::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f3461013-5f80-4173-acda-4cfc57c87ff8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:30:03,393::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:30:03,395::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:30:03,405::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f3461013-5f80-4173-acda-4cfc57c87ff8`::Granted request
>Thread-34::DEBUG::2014-08-21 11:30:03,408::task::827::TaskManager.Task::(resourceAcquired) Task=`da652e0e-5b94-4b85-89a8-a3a306caeba6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:30:03,408::task::990::TaskManager.Task::(_decref) Task=`da652e0e-5b94-4b85-89a8-a3a306caeba6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:30:03,442::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:30:03,444::task::1185::TaskManager.Task::(prepare) Task=`da652e0e-5b94-4b85-89a8-a3a306caeba6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:30:03,446::task::595::TaskManager.Task::(_updateState) Task=`da652e0e-5b94-4b85-89a8-a3a306caeba6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:30:03,447::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:30:03,448::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:30:03,451::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:30:03,453::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:30:03,455::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:30:03,456::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:30:03,459::task::990::TaskManager.Task::(_decref) Task=`da652e0e-5b94-4b85-89a8-a3a306caeba6`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:30:03,471::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:30:03,548::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00159733 s, 312 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:30:04,050::task::595::TaskManager.Task::(_updateState) Task=`52112711-11f6-4480-a8fc-bc45eda81367`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:30:04,051::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:30:04,052::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00159733', 'lastCheck': '0.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:30:04,052::task::1185::TaskManager.Task::(prepare) Task=`52112711-11f6-4480-a8fc-bc45eda81367`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00159733', 'lastCheck': '0.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:30:04,053::task::595::TaskManager.Task::(_updateState) Task=`52112711-11f6-4480-a8fc-bc45eda81367`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:30:04,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:30:04,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:30:04,078::task::990::TaskManager.Task::(_decref) Task=`52112711-11f6-4480-a8fc-bc45eda81367`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:30:04,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:04,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.168797 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:06,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:07,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.343429 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:09,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:10,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.30347 s, 3.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:12,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:12,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.223811 s, 4.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:30:13,636::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-13::DEBUG::2014-08-21 11:30:13,637::task::595::TaskManager.Task::(_updateState) Task=`cb077a05-1867-4eab-9018-faa8a2b001e7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:30:13,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:30:13,638::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:30:13,638::task::1185::TaskManager.Task::(prepare) Task=`cb077a05-1867-4eab-9018-faa8a2b001e7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:30:13,639::task::595::TaskManager.Task::(_updateState) Task=`cb077a05-1867-4eab-9018-faa8a2b001e7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:30:13,639::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:30:13,639::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:30:13,639::task::990::TaskManager.Task::(_decref) Task=`cb077a05-1867-4eab-9018-faa8a2b001e7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:30:13,685::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-34::DEBUG::2014-08-21 11:30:13,686::task::595::TaskManager.Task::(_updateState) Task=`8b63a7e1-6b4b-4385-b2a7-ed79fe3676af`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:30:13,686::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:30:13,687::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d10621ea-9092-4a00-89b0-822cc8599ce7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:30:13,688::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:30:13,688::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:30:13,689::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d10621ea-9092-4a00-89b0-822cc8599ce7`::Granted request
>Thread-34::DEBUG::2014-08-21 11:30:13,690::task::827::TaskManager.Task::(resourceAcquired) Task=`8b63a7e1-6b4b-4385-b2a7-ed79fe3676af`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:30:13,690::task::990::TaskManager.Task::(_decref) Task=`8b63a7e1-6b4b-4385-b2a7-ed79fe3676af`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:30:13,698::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:30:13,698::task::1185::TaskManager.Task::(prepare) Task=`8b63a7e1-6b4b-4385-b2a7-ed79fe3676af`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:30:13,698::task::595::TaskManager.Task::(_updateState) Task=`8b63a7e1-6b4b-4385-b2a7-ed79fe3676af`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:30:13,699::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:30:13,699::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:30:13,700::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:30:13,700::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:30:13,700::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:30:13,701::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:30:13,701::task::990::TaskManager.Task::(_decref) Task=`8b63a7e1-6b4b-4385-b2a7-ed79fe3676af`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:30:14,008::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:30:14,038::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00170984 s, 291 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:14,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:14,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0518963 s, 19.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:16,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:17,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.882336 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:19,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:30:19,909::task::595::TaskManager.Task::(_updateState) Task=`4927d218-1ee3-4a38-be9b-3195a208abcb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:30:19,910::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:30:19,910::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170984', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:30:19,910::task::1185::TaskManager.Task::(prepare) Task=`4927d218-1ee3-4a38-be9b-3195a208abcb`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170984', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:30:19,910::task::595::TaskManager.Task::(_updateState) Task=`4927d218-1ee3-4a38-be9b-3195a208abcb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:30:19,911::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:30:19,911::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:30:19,911::task::990::TaskManager.Task::(_decref) Task=`4927d218-1ee3-4a38-be9b-3195a208abcb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:30:20,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.214618 s, 4.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:22,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:22,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0888366 s, 11.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:30:23,937::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-13::DEBUG::2014-08-21 11:30:23,956::task::595::TaskManager.Task::(_updateState) Task=`99aa5eb5-4989-4650-b7b5-70afcea59fd8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:30:23,976::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:30:23,977::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:30:23,989::task::1185::TaskManager.Task::(prepare) Task=`99aa5eb5-4989-4650-b7b5-70afcea59fd8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:30:23,991::task::595::TaskManager.Task::(_updateState) Task=`99aa5eb5-4989-4650-b7b5-70afcea59fd8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:30:23,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:30:23,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:30:23,997::task::990::TaskManager.Task::(_decref) Task=`99aa5eb5-4989-4650-b7b5-70afcea59fd8`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:30:24,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:30:24,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 11:30:24,537::task::595::TaskManager.Task::(_updateState) Task=`deb7b1ce-b9be-4f49-8389-54418d8e4204`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:30:24,553::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:30:24,555::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`463b2d40-1d81-4e01-b342-faf28cf8b856`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:30:24,555::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:30:24,567::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:30:24,567::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`463b2d40-1d81-4e01-b342-faf28cf8b856`::Granted request
>Thread-34::DEBUG::2014-08-21 11:30:24,568::task::827::TaskManager.Task::(resourceAcquired) Task=`deb7b1ce-b9be-4f49-8389-54418d8e4204`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:30:24,568::task::990::TaskManager.Task::(_decref) Task=`deb7b1ce-b9be-4f49-8389-54418d8e4204`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:30:24,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:30:24,794::task::1185::TaskManager.Task::(prepare) Task=`deb7b1ce-b9be-4f49-8389-54418d8e4204`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:30:24,796::task::595::TaskManager.Task::(_updateState) Task=`deb7b1ce-b9be-4f49-8389-54418d8e4204`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:30:24,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:30:24,813::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:30:24,816::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:30:24,820::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:30:24,824::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:30:24,825::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:30:24,837::task::990::TaskManager.Task::(_decref) Task=`deb7b1ce-b9be-4f49-8389-54418d8e4204`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:30:24,851::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:30:24,954::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000583506 s, 853 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:25,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.604545 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:27,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:27,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0475283 s, 21.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:29,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:31,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.51984 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:33,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:33,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0918618 s, 11.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:38,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:30:38,602::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [65f62e0f]
>Thread-26::DEBUG::2014-08-21 11:30:40,843::task::595::TaskManager.Task::(_updateState) Task=`047d0bb3-45d1-4c80-b6e9-ba71368f3271`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 11:30:40,436::task::595::TaskManager.Task::(_updateState) Task=`cc9ac067-309f-4e38-b7ad-30429fa40b41`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:30:41,508::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:30:41,858::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::INFO::2014-08-21 11:30:41,901::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:30:41,921::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583506', 'lastCheck': '16.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:30:42,004::task::1185::TaskManager.Task::(prepare) Task=`047d0bb3-45d1-4c80-b6e9-ba71368f3271`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583506', 'lastCheck': '16.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:30:41,950::task::1185::TaskManager.Task::(prepare) Task=`cc9ac067-309f-4e38-b7ad-30429fa40b41`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:30:42,488::task::595::TaskManager.Task::(_updateState) Task=`cc9ac067-309f-4e38-b7ad-30429fa40b41`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:30:42,490::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:30:42,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:30:42,501::task::990::TaskManager.Task::(_decref) Task=`cc9ac067-309f-4e38-b7ad-30429fa40b41`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:30:42,475::task::595::TaskManager.Task::(_updateState) Task=`047d0bb3-45d1-4c80-b6e9-ba71368f3271`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:30:42,944::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:30:42,945::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:30:43,041::task::990::TaskManager.Task::(_decref) Task=`047d0bb3-45d1-4c80-b6e9-ba71368f3271`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:30:43,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.58181 s, 223 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:45,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:30:49,241::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [65f62e0f]
>Thread-34::DEBUG::2014-08-21 11:30:49,243::task::595::TaskManager.Task::(_updateState) Task=`c0cf6c68-1ca9-421a-9a5d-37d96b4d2f77`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:30:49,244::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:30:49,244::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7e059356-585b-4f70-8b5f-e2ec0f1d564a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:30:49,245::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:30:49,245::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:30:49,245::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7e059356-585b-4f70-8b5f-e2ec0f1d564a`::Granted request
>Thread-34::DEBUG::2014-08-21 11:30:49,246::task::827::TaskManager.Task::(resourceAcquired) Task=`c0cf6c68-1ca9-421a-9a5d-37d96b4d2f77`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:30:49,246::task::990::TaskManager.Task::(_decref) Task=`c0cf6c68-1ca9-421a-9a5d-37d96b4d2f77`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:30:49,250::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:30:49,251::task::1185::TaskManager.Task::(prepare) Task=`c0cf6c68-1ca9-421a-9a5d-37d96b4d2f77`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:30:49,251::task::595::TaskManager.Task::(_updateState) Task=`c0cf6c68-1ca9-421a-9a5d-37d96b4d2f77`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:30:49,251::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:30:49,252::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:30:49,252::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:30:49,253::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:30:49,253::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:30:49,254::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:30:49,254::task::990::TaskManager.Task::(_decref) Task=`c0cf6c68-1ca9-421a-9a5d-37d96b4d2f77`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:30:49,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:30:49,369::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00363708 s, 137 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:49,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.146595 s, 7.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:30:51,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:30:57,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.898371 s, 1.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:30:59,334::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Dummy-33::DEBUG::2014-08-21 11:30:59,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:31:00,466::task::595::TaskManager.Task::(_updateState) Task=`b64a2c7e-de0f-4acc-892b-79f747b39ef7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:31:00,559::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:31:00,560::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:31:00,560::task::1185::TaskManager.Task::(prepare) Task=`b64a2c7e-de0f-4acc-892b-79f747b39ef7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:31:00,560::task::595::TaskManager.Task::(_updateState) Task=`b64a2c7e-de0f-4acc-892b-79f747b39ef7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:31:00,561::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:31:00,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:31:00,561::task::990::TaskManager.Task::(_decref) Task=`b64a2c7e-de0f-4acc-892b-79f747b39ef7`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:31:00,730::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:31:03,280::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-15::DEBUG::2014-08-21 11:31:03,453::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0306899 s, 16.2 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:31:03,677::task::595::TaskManager.Task::(_updateState) Task=`e7391bc4-e757-49ef-99e3-4b5fa9da09ff`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:31:03,678::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:31:03,679::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4d041477-2f22-4383-bc4e-57a4b5d47738`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:31:03,680::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:31:03,680::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:31:03,680::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4d041477-2f22-4383-bc4e-57a4b5d47738`::Granted request
>Thread-34::DEBUG::2014-08-21 11:31:03,681::task::827::TaskManager.Task::(resourceAcquired) Task=`e7391bc4-e757-49ef-99e3-4b5fa9da09ff`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:31:03,681::task::990::TaskManager.Task::(_decref) Task=`e7391bc4-e757-49ef-99e3-4b5fa9da09ff`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:31:03,786::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:03,787::task::1185::TaskManager.Task::(prepare) Task=`e7391bc4-e757-49ef-99e3-4b5fa9da09ff`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:03,818::task::595::TaskManager.Task::(_updateState) Task=`e7391bc4-e757-49ef-99e3-4b5fa9da09ff`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:31:03,819::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:31:03,831::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:31:03,844::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:31:03,887::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:31:03,888::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:31:03,888::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:31:03,889::task::990::TaskManager.Task::(_decref) Task=`e7391bc4-e757-49ef-99e3-4b5fa9da09ff`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:31:04,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.71463 s, 276 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:06,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:31:07,075::task::595::TaskManager.Task::(_updateState) Task=`f34befe2-29f3-432e-8f6f-53458d529492`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:31:07,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:31:07,078::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0306899', 'lastCheck': '3.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:31:07,078::task::1185::TaskManager.Task::(prepare) Task=`f34befe2-29f3-432e-8f6f-53458d529492`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0306899', 'lastCheck': '3.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:31:07,079::task::595::TaskManager.Task::(_updateState) Task=`f34befe2-29f3-432e-8f6f-53458d529492`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:31:07,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:31:07,080::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:31:07,090::task::990::TaskManager.Task::(_decref) Task=`f34befe2-29f3-432e-8f6f-53458d529492`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:31:08,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.283829 s, 3.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:10,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:10,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.343433 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:12,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:31:14,098::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:31:14,172::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-26::DEBUG::2014-08-21 11:31:14,173::task::595::TaskManager.Task::(_updateState) Task=`6ec7683b-1107-43de-a4f4-1ff36cde4b9a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:31:14,174::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:31:14,175::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:31:14,180::task::1185::TaskManager.Task::(prepare) Task=`6ec7683b-1107-43de-a4f4-1ff36cde4b9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:31:14,204::task::595::TaskManager.Task::(_updateState) Task=`6ec7683b-1107-43de-a4f4-1ff36cde4b9a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:31:14,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:31:14,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:31:14,388::task::990::TaskManager.Task::(_decref) Task=`6ec7683b-1107-43de-a4f4-1ff36cde4b9a`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:31:14,505::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0104314 s, 47.7 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:31:14,895::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 11:31:14,915::task::595::TaskManager.Task::(_updateState) Task=`8fd29c69-a38f-447f-bbd0-1c0f3e807ed5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:31:14,922::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:31:14,924::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6b52d6ba-39f2-48a2-96a8-82f75bf4b07f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:31:14,924::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:31:14,936::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:31:14,936::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6b52d6ba-39f2-48a2-96a8-82f75bf4b07f`::Granted request
>Thread-34::DEBUG::2014-08-21 11:31:14,938::task::827::TaskManager.Task::(resourceAcquired) Task=`8fd29c69-a38f-447f-bbd0-1c0f3e807ed5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:31:14,938::task::990::TaskManager.Task::(_decref) Task=`8fd29c69-a38f-447f-bbd0-1c0f3e807ed5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:31:15,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:15,238::task::1185::TaskManager.Task::(prepare) Task=`8fd29c69-a38f-447f-bbd0-1c0f3e807ed5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:15,239::task::595::TaskManager.Task::(_updateState) Task=`8fd29c69-a38f-447f-bbd0-1c0f3e807ed5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:31:15,239::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:31:15,240::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:31:15,241::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:31:15,242::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:31:15,242::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:31:15,243::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:31:15,244::task::990::TaskManager.Task::(_decref) Task=`8fd29c69-a38f-447f-bbd0-1c0f3e807ed5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:31:15,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.42047 s, 423 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:17,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:17,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0994959 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:20,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:20,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.143705 s, 7.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:22,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:22,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.051455 s, 19.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:31:23,651::task::595::TaskManager.Task::(_updateState) Task=`44a7a332-38e8-42a7-9f09-03842aeaadb4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:31:23,652::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:31:23,653::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0104314', 'lastCheck': '8.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:31:23,653::task::1185::TaskManager.Task::(prepare) Task=`44a7a332-38e8-42a7-9f09-03842aeaadb4`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0104314', 'lastCheck': '8.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:31:23,653::task::595::TaskManager.Task::(_updateState) Task=`44a7a332-38e8-42a7-9f09-03842aeaadb4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:31:23,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:31:23,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:31:23,654::task::990::TaskManager.Task::(_decref) Task=`44a7a332-38e8-42a7-9f09-03842aeaadb4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:31:24,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:31:25,930::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-13::DEBUG::2014-08-21 11:31:25,933::task::595::TaskManager.Task::(_updateState) Task=`6a1493a7-58e1-4c9f-9ec1-faba6491315b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:31:25,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:31:25,935::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:31:25,935::task::1185::TaskManager.Task::(prepare) Task=`6a1493a7-58e1-4c9f-9ec1-faba6491315b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:31:25,936::task::595::TaskManager.Task::(_updateState) Task=`6a1493a7-58e1-4c9f-9ec1-faba6491315b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:31:25,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:31:25,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:31:25,937::task::990::TaskManager.Task::(_decref) Task=`6a1493a7-58e1-4c9f-9ec1-faba6491315b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:31:26,215::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f0b7c39]
>Thread-34::DEBUG::2014-08-21 11:31:26,217::task::595::TaskManager.Task::(_updateState) Task=`18851ef8-02bd-4caa-96fc-8482919a66a2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:31:26,218::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:31:26,219::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`762620da-4720-4430-b30b-0783657d5c6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:31:26,219::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:31:26,220::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:31:26,220::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`762620da-4720-4430-b30b-0783657d5c6c`::Granted request
>Thread-34::DEBUG::2014-08-21 11:31:26,258::task::827::TaskManager.Task::(resourceAcquired) Task=`18851ef8-02bd-4caa-96fc-8482919a66a2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:31:26,292::task::990::TaskManager.Task::(_decref) Task=`18851ef8-02bd-4caa-96fc-8482919a66a2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:31:26,800::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:26,800::task::1185::TaskManager.Task::(prepare) Task=`18851ef8-02bd-4caa-96fc-8482919a66a2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:26,801::task::595::TaskManager.Task::(_updateState) Task=`18851ef8-02bd-4caa-96fc-8482919a66a2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:31:26,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:31:26,802::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:31:26,803::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:31:26,803::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:31:26,804::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:31:26,804::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:31:26,805::task::990::TaskManager.Task::(_decref) Task=`18851ef8-02bd-4caa-96fc-8482919a66a2`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:31:26,942::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:31:27,164::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0032454 s, 153 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:27,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.36733 s, 433 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:29,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:29,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.152794 s, 6.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:31,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:31,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0706826 s, 14.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:33,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:33,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580091 s, 17.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:35,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:36,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.156121 s, 6.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:31:37,012::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-13::DEBUG::2014-08-21 11:31:37,015::task::595::TaskManager.Task::(_updateState) Task=`c8868d34-c698-426a-abbe-6c07789a0dc4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:31:37,016::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:31:37,017::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:31:37,020::task::1185::TaskManager.Task::(prepare) Task=`c8868d34-c698-426a-abbe-6c07789a0dc4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:31:37,020::task::595::TaskManager.Task::(_updateState) Task=`c8868d34-c698-426a-abbe-6c07789a0dc4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:31:37,021::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:31:37,021::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:31:37,022::task::990::TaskManager.Task::(_decref) Task=`c8868d34-c698-426a-abbe-6c07789a0dc4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:31:37,029::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-34::DEBUG::2014-08-21 11:31:37,031::task::595::TaskManager.Task::(_updateState) Task=`27faddde-d478-41a3-b004-ad3f552f3226`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:31:37,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:31:37,033::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9052044e-4ac2-4011-a2f2-2037d8db3216`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:31:37,033::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:31:37,034::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:31:37,034::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9052044e-4ac2-4011-a2f2-2037d8db3216`::Granted request
>Thread-34::DEBUG::2014-08-21 11:31:37,035::task::827::TaskManager.Task::(resourceAcquired) Task=`27faddde-d478-41a3-b004-ad3f552f3226`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:31:37,035::task::990::TaskManager.Task::(_decref) Task=`27faddde-d478-41a3-b004-ad3f552f3226`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:31:37,044::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:37,045::task::1185::TaskManager.Task::(prepare) Task=`27faddde-d478-41a3-b004-ad3f552f3226`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:37,045::task::595::TaskManager.Task::(_updateState) Task=`27faddde-d478-41a3-b004-ad3f552f3226`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:31:37,046::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:31:37,046::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:31:37,047::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:31:37,047::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:31:37,047::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:31:37,048::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:31:37,048::task::990::TaskManager.Task::(_decref) Task=`27faddde-d478-41a3-b004-ad3f552f3226`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:31:37,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:31:37,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000695364 s, 716 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:38,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:38,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0630231 s, 16.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:31:39,069::task::595::TaskManager.Task::(_updateState) Task=`c21f1127-19a0-4798-bda2-fc3b46f59f7c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:31:39,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:31:39,071::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695364', 'lastCheck': '1.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:31:39,071::task::1185::TaskManager.Task::(prepare) Task=`c21f1127-19a0-4798-bda2-fc3b46f59f7c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695364', 'lastCheck': '1.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:31:39,071::task::595::TaskManager.Task::(_updateState) Task=`c21f1127-19a0-4798-bda2-fc3b46f59f7c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:31:39,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:31:39,072::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:31:39,072::task::990::TaskManager.Task::(_decref) Task=`c21f1127-19a0-4798-bda2-fc3b46f59f7c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:31:40,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:41,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.17097 s, 874 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:43,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:43,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.129592 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:45,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:46,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0669009 s, 15.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:31:47,104::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-13::DEBUG::2014-08-21 11:31:47,109::task::595::TaskManager.Task::(_updateState) Task=`1a02fe5e-a2fe-4695-a438-7b20c72c681a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:31:47,110::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:31:47,110::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:31:47,111::task::1185::TaskManager.Task::(prepare) Task=`1a02fe5e-a2fe-4695-a438-7b20c72c681a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:31:47,111::task::595::TaskManager.Task::(_updateState) Task=`1a02fe5e-a2fe-4695-a438-7b20c72c681a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:31:47,111::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:31:47,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:31:47,112::task::990::TaskManager.Task::(_decref) Task=`1a02fe5e-a2fe-4695-a438-7b20c72c681a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:31:47,142::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-34::DEBUG::2014-08-21 11:31:47,143::task::595::TaskManager.Task::(_updateState) Task=`ca2ca4d8-d80f-477a-ba3f-dbf9954cb7c0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:31:47,143::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:31:47,160::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1b30543-2e68-451a-8f78-3767d6cd7b9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:31:47,161::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:31:47,161::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:31:47,161::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1b30543-2e68-451a-8f78-3767d6cd7b9c`::Granted request
>Thread-34::DEBUG::2014-08-21 11:31:47,162::task::827::TaskManager.Task::(resourceAcquired) Task=`ca2ca4d8-d80f-477a-ba3f-dbf9954cb7c0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:31:47,163::task::990::TaskManager.Task::(_decref) Task=`ca2ca4d8-d80f-477a-ba3f-dbf9954cb7c0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:31:47,187::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:47,188::task::1185::TaskManager.Task::(prepare) Task=`ca2ca4d8-d80f-477a-ba3f-dbf9954cb7c0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:47,188::task::595::TaskManager.Task::(_updateState) Task=`ca2ca4d8-d80f-477a-ba3f-dbf9954cb7c0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:31:47,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:31:47,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:31:47,189::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:31:47,190::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:31:47,190::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:31:47,190::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:31:47,191::task::990::TaskManager.Task::(_decref) Task=`ca2ca4d8-d80f-477a-ba3f-dbf9954cb7c0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:31:47,386::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:48,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:31:48,487::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00974206 s, 51.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:49,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.572708 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:51,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:31:51,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175458 s, 5.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:57,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:31:57,568::task::595::TaskManager.Task::(_updateState) Task=`683e494c-47ab-45b1-be08-d8b5d4dc1d54`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 11:31:57,569::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-26::DEBUG::2014-08-21 11:31:57,594::task::595::TaskManager.Task::(_updateState) Task=`63a5cfc4-a15b-40a7-937a-502d49470d58`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:31:57,594::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:31:57,595::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:31:57,595::task::1185::TaskManager.Task::(prepare) Task=`63a5cfc4-a15b-40a7-937a-502d49470d58`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:31:57,595::task::595::TaskManager.Task::(_updateState) Task=`63a5cfc4-a15b-40a7-937a-502d49470d58`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:31:57,595::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:31:57,596::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:31:57,596::task::990::TaskManager.Task::(_decref) Task=`63a5cfc4-a15b-40a7-937a-502d49470d58`::ref 0 aborting False
>Thread-13::INFO::2014-08-21 11:31:57,592::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:31:57,597::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00974206', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:31:57,597::task::1185::TaskManager.Task::(prepare) Task=`683e494c-47ab-45b1-be08-d8b5d4dc1d54`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00974206', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:31:57,597::task::595::TaskManager.Task::(_updateState) Task=`683e494c-47ab-45b1-be08-d8b5d4dc1d54`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:31:57,598::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:31:57,598::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:31:57,598::task::990::TaskManager.Task::(_decref) Task=`683e494c-47ab-45b1-be08-d8b5d4dc1d54`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:31:57,651::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 11:31:57,655::task::595::TaskManager.Task::(_updateState) Task=`784602b0-f9b4-4ed3-97eb-9e2bc26ca696`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:31:57,657::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:31:57,661::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6369465e-31f7-4f75-8e66-f4c26f27e0ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:31:57,668::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:31:57,695::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:31:57,711::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6369465e-31f7-4f75-8e66-f4c26f27e0ec`::Granted request
>Thread-34::DEBUG::2014-08-21 11:31:57,721::task::827::TaskManager.Task::(resourceAcquired) Task=`784602b0-f9b4-4ed3-97eb-9e2bc26ca696`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:31:57,723::task::990::TaskManager.Task::(_decref) Task=`784602b0-f9b4-4ed3-97eb-9e2bc26ca696`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:31:57,786::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:57,788::task::1185::TaskManager.Task::(prepare) Task=`784602b0-f9b4-4ed3-97eb-9e2bc26ca696`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:31:57,790::task::595::TaskManager.Task::(_updateState) Task=`784602b0-f9b4-4ed3-97eb-9e2bc26ca696`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:31:57,791::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:31:57,792::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:31:57,794::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:31:57,795::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:31:57,796::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:31:57,797::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:31:57,798::task::990::TaskManager.Task::(_decref) Task=`784602b0-f9b4-4ed3-97eb-9e2bc26ca696`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:31:57,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.263423 s, 3.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:31:58,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:31:58,988::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000690688 s, 721 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:31:59,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:02,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.89512 s, 540 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:04,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:04,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0706944 s, 14.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:06,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:32:08,235::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-26::DEBUG::2014-08-21 11:32:08,266::task::595::TaskManager.Task::(_updateState) Task=`0d420bd8-30ba-4846-afe9-607e975b4b2c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:32:10,651::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:32:10,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:10,783::task::1185::TaskManager.Task::(prepare) Task=`0d420bd8-30ba-4846-afe9-607e975b4b2c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:10,794::task::595::TaskManager.Task::(_updateState) Task=`0d420bd8-30ba-4846-afe9-607e975b4b2c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:32:10,919::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:32:10,966::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:32:11,029::task::990::TaskManager.Task::(_decref) Task=`0d420bd8-30ba-4846-afe9-607e975b4b2c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:32:11,289::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-34::DEBUG::2014-08-21 11:32:11,301::task::595::TaskManager.Task::(_updateState) Task=`b11a43f6-bb1d-46b0-9231-8b817283f5cd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:32:11,301::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:32:11,302::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2ac696f5-04e2-47f4-bad9-f927e35ad4fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:32:11,303::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:32:11,314::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:32:11,314::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2ac696f5-04e2-47f4-bad9-f927e35ad4fa`::Granted request
>Thread-34::DEBUG::2014-08-21 11:32:11,315::task::827::TaskManager.Task::(resourceAcquired) Task=`b11a43f6-bb1d-46b0-9231-8b817283f5cd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:32:11,315::task::990::TaskManager.Task::(_decref) Task=`b11a43f6-bb1d-46b0-9231-8b817283f5cd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:32:11,320::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:32:11,320::task::1185::TaskManager.Task::(prepare) Task=`b11a43f6-bb1d-46b0-9231-8b817283f5cd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:32:11,320::task::595::TaskManager.Task::(_updateState) Task=`b11a43f6-bb1d-46b0-9231-8b817283f5cd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:32:11,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:32:11,321::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:32:11,322::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:32:11,331::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:32:11,332::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:32:11,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:32:11,333::task::990::TaskManager.Task::(_decref) Task=`b11a43f6-bb1d-46b0-9231-8b817283f5cd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:32:11,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:32:11,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00698766 s, 71.3 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:11,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.55147 s, 184 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:13,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:14,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.117509 s, 8.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:16,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:16,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521108 s, 19.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:32:16,664::task::595::TaskManager.Task::(_updateState) Task=`c23b317b-648e-4f24-82af-810fb4db8540`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:32:16,665::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:32:16,665::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00698766', 'lastCheck': '4.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:32:16,665::task::1185::TaskManager.Task::(prepare) Task=`c23b317b-648e-4f24-82af-810fb4db8540`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00698766', 'lastCheck': '4.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:32:16,665::task::595::TaskManager.Task::(_updateState) Task=`c23b317b-648e-4f24-82af-810fb4db8540`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:32:16,665::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:32:16,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:32:16,666::task::990::TaskManager.Task::(_decref) Task=`c23b317b-648e-4f24-82af-810fb4db8540`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:32:18,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:18,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125228 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:20,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:32:21,482::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-26::DEBUG::2014-08-21 11:32:21,541::task::595::TaskManager.Task::(_updateState) Task=`21a7987f-a110-4aed-a8e7-ac8b7ae85505`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:32:21,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 11:32:21,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.392997 s, 2.6 MB/s\n'; <rc> = 0
>Thread-26::INFO::2014-08-21 11:32:21,547::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:21,548::task::1185::TaskManager.Task::(prepare) Task=`21a7987f-a110-4aed-a8e7-ac8b7ae85505`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:21,550::task::595::TaskManager.Task::(_updateState) Task=`21a7987f-a110-4aed-a8e7-ac8b7ae85505`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:32:21,551::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:32:21,552::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:32:21,554::task::990::TaskManager.Task::(_decref) Task=`21a7987f-a110-4aed-a8e7-ac8b7ae85505`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:32:21,571::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-34::DEBUG::2014-08-21 11:32:21,572::task::595::TaskManager.Task::(_updateState) Task=`c8d21248-ba38-46ae-b09c-831f4d33698c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:32:21,572::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:32:21,573::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a7356956-ebf0-41fa-af01-ae11cac066c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:32:21,573::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:32:21,574::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:32:21,574::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a7356956-ebf0-41fa-af01-ae11cac066c5`::Granted request
>Thread-34::DEBUG::2014-08-21 11:32:21,574::task::827::TaskManager.Task::(resourceAcquired) Task=`c8d21248-ba38-46ae-b09c-831f4d33698c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:32:21,575::task::990::TaskManager.Task::(_decref) Task=`c8d21248-ba38-46ae-b09c-831f4d33698c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:32:21,579::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:32:21,579::task::1185::TaskManager.Task::(prepare) Task=`c8d21248-ba38-46ae-b09c-831f4d33698c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:32:21,579::task::595::TaskManager.Task::(_updateState) Task=`c8d21248-ba38-46ae-b09c-831f4d33698c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:32:21,579::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:32:21,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:32:21,580::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:32:21,580::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:32:21,580::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:32:21,580::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:32:21,581::task::990::TaskManager.Task::(_decref) Task=`c8d21248-ba38-46ae-b09c-831f4d33698c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:32:21,827::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:32:21,835::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:32:21,837::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:32:21,844::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 11:32:21,845::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:32:21,846::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:32:21,846::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 11:32:21,855::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:32:21,869::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00135295 s, 368 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:23,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:23,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.318984 s, 3.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:26,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:26,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.216375 s, 4.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:28,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:28,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.163889 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:30,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:30,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0697985 s, 14.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:32:31,605::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7025d910]
>Thread-26::DEBUG::2014-08-21 11:32:31,606::task::595::TaskManager.Task::(_updateState) Task=`ec4b20dc-3c71-49c7-a0ef-e72c7fe50702`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:32:31,607::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:32:31,607::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:31,608::task::1185::TaskManager.Task::(prepare) Task=`ec4b20dc-3c71-49c7-a0ef-e72c7fe50702`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:31,608::task::595::TaskManager.Task::(_updateState) Task=`ec4b20dc-3c71-49c7-a0ef-e72c7fe50702`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:32:31,608::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:32:31,608::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:32:31,609::task::990::TaskManager.Task::(_decref) Task=`ec4b20dc-3c71-49c7-a0ef-e72c7fe50702`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:32:31,616::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7025d910]
>Thread-34::DEBUG::2014-08-21 11:32:31,617::task::595::TaskManager.Task::(_updateState) Task=`0c75f7e4-cac6-449b-9ab3-a0c2414e1db2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:32:31,618::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:32:31,619::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`84801d5c-6ced-4f30-a691-35e1090552fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:32:31,619::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:32:31,620::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:32:31,620::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`84801d5c-6ced-4f30-a691-35e1090552fe`::Granted request
>Thread-34::DEBUG::2014-08-21 11:32:31,620::task::827::TaskManager.Task::(resourceAcquired) Task=`0c75f7e4-cac6-449b-9ab3-a0c2414e1db2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:32:31,621::task::990::TaskManager.Task::(_decref) Task=`0c75f7e4-cac6-449b-9ab3-a0c2414e1db2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:32:31,627::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:32:31,627::task::1185::TaskManager.Task::(prepare) Task=`0c75f7e4-cac6-449b-9ab3-a0c2414e1db2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:32:31,628::task::595::TaskManager.Task::(_updateState) Task=`0c75f7e4-cac6-449b-9ab3-a0c2414e1db2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:32:31,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:32:31,629::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:32:31,629::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:32:31,630::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:32:31,630::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:32:31,630::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:32:31,631::task::990::TaskManager.Task::(_decref) Task=`0c75f7e4-cac6-449b-9ab3-a0c2414e1db2`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:32:31,803::task::595::TaskManager.Task::(_updateState) Task=`81123c53-cf61-4457-81d1-e710e8de50e3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:32:31,803::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:32:31,804::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00135295', 'lastCheck': '9.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:32:31,804::task::1185::TaskManager.Task::(prepare) Task=`81123c53-cf61-4457-81d1-e710e8de50e3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00135295', 'lastCheck': '9.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:32:31,804::task::595::TaskManager.Task::(_updateState) Task=`81123c53-cf61-4457-81d1-e710e8de50e3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:32:31,804::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:32:31,805::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:32:31,805::task::990::TaskManager.Task::(_decref) Task=`81123c53-cf61-4457-81d1-e710e8de50e3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:32:31,899::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:32:31,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000493467 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:32,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:33,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.362921 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:35,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:36,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.402397 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:38,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:38,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124567 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:40,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:32:41,725::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-26::DEBUG::2014-08-21 11:32:41,727::task::595::TaskManager.Task::(_updateState) Task=`d278302b-43b5-4333-be7b-c412e8a5cc48`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:32:41,728::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:32:41,730::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:41,730::task::1185::TaskManager.Task::(prepare) Task=`d278302b-43b5-4333-be7b-c412e8a5cc48`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:41,801::task::595::TaskManager.Task::(_updateState) Task=`d278302b-43b5-4333-be7b-c412e8a5cc48`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:32:41,904::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:32:41,906::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:32:41,907::task::990::TaskManager.Task::(_decref) Task=`d278302b-43b5-4333-be7b-c412e8a5cc48`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:32:42,030::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-34::DEBUG::2014-08-21 11:32:42,042::task::595::TaskManager.Task::(_updateState) Task=`54abaa93-be02-4800-8e2c-6b25da6471d1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:32:42,050::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:32:42,066::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7710a18c-bed3-44f7-9841-5087cc68b344`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:32:42,076::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:32:42,086::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:32:42,090::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7710a18c-bed3-44f7-9841-5087cc68b344`::Granted request
>Thread-34::DEBUG::2014-08-21 11:32:42,099::task::827::TaskManager.Task::(resourceAcquired) Task=`54abaa93-be02-4800-8e2c-6b25da6471d1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:32:42,103::task::990::TaskManager.Task::(_decref) Task=`54abaa93-be02-4800-8e2c-6b25da6471d1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:32:42,190::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:32:42,194::task::1185::TaskManager.Task::(prepare) Task=`54abaa93-be02-4800-8e2c-6b25da6471d1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:32:42,197::task::595::TaskManager.Task::(_updateState) Task=`54abaa93-be02-4800-8e2c-6b25da6471d1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:32:42,200::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:32:42,204::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:32:42,210::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:32:42,216::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:32:42,219::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:32:42,223::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:32:42,230::task::990::TaskManager.Task::(_decref) Task=`54abaa93-be02-4800-8e2c-6b25da6471d1`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:32:42,292::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:32:42,331::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000879479 s, 566 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:42,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170422 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:44,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:46,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.808682 s, 1.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:32:47,927::task::595::TaskManager.Task::(_updateState) Task=`784b4f82-4ab8-498a-bb97-52e30460ac60`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:32:47,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:32:47,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000879479', 'lastCheck': '5.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:32:47,929::task::1185::TaskManager.Task::(prepare) Task=`784b4f82-4ab8-498a-bb97-52e30460ac60`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000879479', 'lastCheck': '5.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:32:47,929::task::595::TaskManager.Task::(_updateState) Task=`784b4f82-4ab8-498a-bb97-52e30460ac60`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:32:47,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:32:47,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:32:47,930::task::990::TaskManager.Task::(_decref) Task=`784b4f82-4ab8-498a-bb97-52e30460ac60`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:32:48,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:48,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0587706 s, 17.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:50,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:32:52,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-26::DEBUG::2014-08-21 11:32:52,812::task::595::TaskManager.Task::(_updateState) Task=`772cb1f2-b1db-4684-bcc9-42712e75d24a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:32:52,840::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:32:52,851::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:52,858::task::1185::TaskManager.Task::(prepare) Task=`772cb1f2-b1db-4684-bcc9-42712e75d24a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:32:52,865::task::595::TaskManager.Task::(_updateState) Task=`772cb1f2-b1db-4684-bcc9-42712e75d24a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:32:52,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:32:52,877::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:32:52,882::task::990::TaskManager.Task::(_decref) Task=`772cb1f2-b1db-4684-bcc9-42712e75d24a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:32:52,934::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-34::DEBUG::2014-08-21 11:32:52,941::task::595::TaskManager.Task::(_updateState) Task=`94eccb31-437a-4daa-baf7-4b47f71c2c04`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:32:52,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:32:52,955::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`14fc915f-ff29-42b4-a485-7c3f64ba8eb2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:32:52,958::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 11:32:52,957::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:32:52,972::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:32:52,974::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`14fc915f-ff29-42b4-a485-7c3f64ba8eb2`::Granted request
>Thread-34::DEBUG::2014-08-21 11:32:52,978::task::827::TaskManager.Task::(resourceAcquired) Task=`94eccb31-437a-4daa-baf7-4b47f71c2c04`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:32:52,980::task::990::TaskManager.Task::(_decref) Task=`94eccb31-437a-4daa-baf7-4b47f71c2c04`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:32:53,027::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-15::DEBUG::2014-08-21 11:32:53,025::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000354356 s, 1.4 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:32:53,029::task::1185::TaskManager.Task::(prepare) Task=`94eccb31-437a-4daa-baf7-4b47f71c2c04`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:32:53,032::task::595::TaskManager.Task::(_updateState) Task=`94eccb31-437a-4daa-baf7-4b47f71c2c04`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:32:53,036::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:32:53,037::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:32:53,041::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:32:53,044::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:32:53,045::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:32:53,047::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:32:53,051::task::990::TaskManager.Task::(_decref) Task=`94eccb31-437a-4daa-baf7-4b47f71c2c04`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:32:53,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.82345 s, 562 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:55,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:55,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0601465 s, 17.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:32:57,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:32:59,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.75001 s, 585 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:01,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:02,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.346277 s, 3.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:33:04,453::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-13::DEBUG::2014-08-21 11:33:04,955::task::595::TaskManager.Task::(_updateState) Task=`992efe13-65be-4e4b-8930-0cd5e944ad24`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:33:04,957::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:33:04,957::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354356', 'lastCheck': '11.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:33:04,958::task::1185::TaskManager.Task::(prepare) Task=`992efe13-65be-4e4b-8930-0cd5e944ad24`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354356', 'lastCheck': '11.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:33:04,970::task::595::TaskManager.Task::(_updateState) Task=`992efe13-65be-4e4b-8930-0cd5e944ad24`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:33:05,090::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:33:05,090::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:33:05,091::task::990::TaskManager.Task::(_decref) Task=`992efe13-65be-4e4b-8930-0cd5e944ad24`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:33:04,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:33:05,046::task::595::TaskManager.Task::(_updateState) Task=`dc574ddb-3e6f-4a17-bcb5-9311f3665b82`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:33:06,899::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:33:07,425::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-15::DEBUG::2014-08-21 11:33:07,666::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:33:08,168::task::1185::TaskManager.Task::(prepare) Task=`dc574ddb-3e6f-4a17-bcb5-9311f3665b82`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:08,170::task::595::TaskManager.Task::(_updateState) Task=`dc574ddb-3e6f-4a17-bcb5-9311f3665b82`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:33:08,170::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:33:08,170::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:33:08,171::task::990::TaskManager.Task::(_decref) Task=`dc574ddb-3e6f-4a17-bcb5-9311f3665b82`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:33:08,350::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0132672 s, 37.5 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:33:08,460::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-34::DEBUG::2014-08-21 11:33:08,461::task::595::TaskManager.Task::(_updateState) Task=`0e514978-38f6-4d45-91cf-f063ff9b651d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:33:08,461::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:33:08,462::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e482bebf-14d5-43b3-8c07-582b4e058da1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:33:08,463::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:33:08,463::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:33:08,463::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e482bebf-14d5-43b3-8c07-582b4e058da1`::Granted request
>Thread-34::DEBUG::2014-08-21 11:33:08,469::task::827::TaskManager.Task::(resourceAcquired) Task=`0e514978-38f6-4d45-91cf-f063ff9b651d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:33:08,471::task::990::TaskManager.Task::(_decref) Task=`0e514978-38f6-4d45-91cf-f063ff9b651d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:33:08,548::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:08,549::task::1185::TaskManager.Task::(prepare) Task=`0e514978-38f6-4d45-91cf-f063ff9b651d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:08,549::task::595::TaskManager.Task::(_updateState) Task=`0e514978-38f6-4d45-91cf-f063ff9b651d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:33:08,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:33:08,550::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:33:08,551::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:33:08,551::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:33:08,558::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:33:08,559::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:33:08,559::task::990::TaskManager.Task::(_decref) Task=`0e514978-38f6-4d45-91cf-f063ff9b651d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:33:09,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.78235 s, 271 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:12,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:12,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103399 s, 9.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:14,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:17,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.95106 s, 525 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:33:19,011::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-26::DEBUG::2014-08-21 11:33:19,012::task::595::TaskManager.Task::(_updateState) Task=`a2444c04-e0e3-4ef7-8943-02b244068e08`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:33:19,013::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:33:19,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:19,014::task::1185::TaskManager.Task::(prepare) Task=`a2444c04-e0e3-4ef7-8943-02b244068e08`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:19,014::task::595::TaskManager.Task::(_updateState) Task=`a2444c04-e0e3-4ef7-8943-02b244068e08`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:33:19,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:33:19,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:33:19,015::task::990::TaskManager.Task::(_decref) Task=`a2444c04-e0e3-4ef7-8943-02b244068e08`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:33:19,020::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 11:33:19,021::task::595::TaskManager.Task::(_updateState) Task=`3aa04478-4b4d-42de-a14d-b6e61de886f2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:33:19,021::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:33:19,022::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`11f075a4-a559-4c3c-b2fd-525871a837f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:33:19,022::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:33:19,023::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:33:19,023::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`11f075a4-a559-4c3c-b2fd-525871a837f5`::Granted request
>Thread-34::DEBUG::2014-08-21 11:33:19,024::task::827::TaskManager.Task::(resourceAcquired) Task=`3aa04478-4b4d-42de-a14d-b6e61de886f2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:33:19,024::task::990::TaskManager.Task::(_decref) Task=`3aa04478-4b4d-42de-a14d-b6e61de886f2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:33:19,028::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:19,029::task::1185::TaskManager.Task::(prepare) Task=`3aa04478-4b4d-42de-a14d-b6e61de886f2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:19,029::task::595::TaskManager.Task::(_updateState) Task=`3aa04478-4b4d-42de-a14d-b6e61de886f2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:33:19,029::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:33:19,029::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:33:19,030::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:33:19,030::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:33:19,031::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:33:19,031::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:33:19,031::task::990::TaskManager.Task::(_decref) Task=`3aa04478-4b4d-42de-a14d-b6e61de886f2`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:33:19,099::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:33:19,119::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000431225 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:19,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:20,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.275297 s, 3.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:22,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:23,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0592286 s, 17.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:33:24,225::task::595::TaskManager.Task::(_updateState) Task=`0b56a3f0-a80f-4a60-9ab7-be6144e9e3bc`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:33:24,226::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:33:24,226::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431225', 'lastCheck': '5.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:33:24,227::task::1185::TaskManager.Task::(prepare) Task=`0b56a3f0-a80f-4a60-9ab7-be6144e9e3bc`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431225', 'lastCheck': '5.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:33:24,227::task::595::TaskManager.Task::(_updateState) Task=`0b56a3f0-a80f-4a60-9ab7-be6144e9e3bc`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:33:24,227::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:33:24,228::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:33:24,228::task::990::TaskManager.Task::(_decref) Task=`0b56a3f0-a80f-4a60-9ab7-be6144e9e3bc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:33:25,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:25,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458803 s, 22.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:27,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:27,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.234331 s, 4.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:33:29,049::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [ffadda0]
>Thread-26::DEBUG::2014-08-21 11:33:29,051::task::595::TaskManager.Task::(_updateState) Task=`926d9660-5751-4ebe-aa3c-b3713c8cbc5c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:33:29,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:33:29,052::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:29,052::task::1185::TaskManager.Task::(prepare) Task=`926d9660-5751-4ebe-aa3c-b3713c8cbc5c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:29,053::task::595::TaskManager.Task::(_updateState) Task=`926d9660-5751-4ebe-aa3c-b3713c8cbc5c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:33:29,053::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:33:29,053::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:33:29,053::task::990::TaskManager.Task::(_decref) Task=`926d9660-5751-4ebe-aa3c-b3713c8cbc5c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:33:29,062::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [ffadda0]
>Thread-34::DEBUG::2014-08-21 11:33:29,063::task::595::TaskManager.Task::(_updateState) Task=`a2b9c814-52ae-432f-a405-273857bd8c64`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:33:29,063::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:33:29,064::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1274af19-7829-484d-a4e7-c9dd10a44ab3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:33:29,064::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:33:29,065::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:33:29,065::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1274af19-7829-484d-a4e7-c9dd10a44ab3`::Granted request
>Thread-34::DEBUG::2014-08-21 11:33:29,065::task::827::TaskManager.Task::(resourceAcquired) Task=`a2b9c814-52ae-432f-a405-273857bd8c64`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:33:29,066::task::990::TaskManager.Task::(_decref) Task=`a2b9c814-52ae-432f-a405-273857bd8c64`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:33:29,070::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:29,070::task::1185::TaskManager.Task::(prepare) Task=`a2b9c814-52ae-432f-a405-273857bd8c64`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:29,070::task::595::TaskManager.Task::(_updateState) Task=`a2b9c814-52ae-432f-a405-273857bd8c64`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:33:29,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:33:29,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:33:29,071::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:33:29,071::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:33:29,071::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:33:29,071::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:33:29,072::task::990::TaskManager.Task::(_decref) Task=`a2b9c814-52ae-432f-a405-273857bd8c64`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:33:29,145::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:33:29,161::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000527191 s, 945 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:29,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:29,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0623628 s, 16.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:31,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:31,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0540584 s, 18.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:33,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:33,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0844838 s, 12.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:35,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:36,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.313812 s, 3.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:38,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:33:39,092::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-26::DEBUG::2014-08-21 11:33:39,094::task::595::TaskManager.Task::(_updateState) Task=`dd32e612-6b08-4e0d-8e7f-d990d31247e2`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:33:39,095::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:33:39,097::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:39,097::task::1185::TaskManager.Task::(prepare) Task=`dd32e612-6b08-4e0d-8e7f-d990d31247e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:39,098::task::595::TaskManager.Task::(_updateState) Task=`dd32e612-6b08-4e0d-8e7f-d990d31247e2`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:33:39,098::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:33:39,098::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:33:39,098::task::990::TaskManager.Task::(_decref) Task=`dd32e612-6b08-4e0d-8e7f-d990d31247e2`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:33:39,104::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-34::DEBUG::2014-08-21 11:33:39,106::task::595::TaskManager.Task::(_updateState) Task=`4991adaa-f1c1-4fda-861d-fd6e687c228d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:33:39,106::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:33:39,107::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0ac9f89d-2075-42db-a6bb-629646fcbe90`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:33:39,107::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:33:39,108::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:33:39,109::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0ac9f89d-2075-42db-a6bb-629646fcbe90`::Granted request
>Thread-34::DEBUG::2014-08-21 11:33:39,110::task::827::TaskManager.Task::(resourceAcquired) Task=`4991adaa-f1c1-4fda-861d-fd6e687c228d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:33:39,110::task::990::TaskManager.Task::(_decref) Task=`4991adaa-f1c1-4fda-861d-fd6e687c228d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:33:39,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:39,115::task::1185::TaskManager.Task::(prepare) Task=`4991adaa-f1c1-4fda-861d-fd6e687c228d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:39,115::task::595::TaskManager.Task::(_updateState) Task=`4991adaa-f1c1-4fda-861d-fd6e687c228d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:33:39,116::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:33:39,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:33:39,116::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:33:39,117::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:33:39,117::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:33:39,117::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:33:39,117::task::990::TaskManager.Task::(_decref) Task=`4991adaa-f1c1-4fda-861d-fd6e687c228d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:33:39,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:33:39,321::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000474941 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:39,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100915 s, 10.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:33:39,638::task::595::TaskManager.Task::(_updateState) Task=`213da3c7-1db8-4c93-8129-6eff19dc5069`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:33:39,638::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:33:39,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474941', 'lastCheck': '0.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:33:39,639::task::1185::TaskManager.Task::(prepare) Task=`213da3c7-1db8-4c93-8129-6eff19dc5069`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474941', 'lastCheck': '0.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:33:39,639::task::595::TaskManager.Task::(_updateState) Task=`213da3c7-1db8-4c93-8129-6eff19dc5069`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:33:39,639::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:33:39,640::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:33:39,640::task::990::TaskManager.Task::(_decref) Task=`213da3c7-1db8-4c93-8129-6eff19dc5069`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:33:41,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:41,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.113464 s, 9.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:43,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:45,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.22274 s, 461 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:47,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:48,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462817 s, 22.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:33:49,146::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-26::DEBUG::2014-08-21 11:33:49,148::task::595::TaskManager.Task::(_updateState) Task=`2c886823-f2b9-44c4-8eab-c7b2f253a1c9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:33:49,148::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:33:49,150::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:49,150::task::1185::TaskManager.Task::(prepare) Task=`2c886823-f2b9-44c4-8eab-c7b2f253a1c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:49,150::task::595::TaskManager.Task::(_updateState) Task=`2c886823-f2b9-44c4-8eab-c7b2f253a1c9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:33:49,151::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:33:49,151::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:33:49,151::task::990::TaskManager.Task::(_decref) Task=`2c886823-f2b9-44c4-8eab-c7b2f253a1c9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:33:49,181::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-34::DEBUG::2014-08-21 11:33:49,255::task::595::TaskManager.Task::(_updateState) Task=`dfebf332-3d74-4cc6-ba19-03922d240bd9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:33:49,255::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:33:49,256::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2d416abc-73e5-4022-b5df-31e040f48917`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:33:49,256::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:33:49,257::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:33:49,257::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2d416abc-73e5-4022-b5df-31e040f48917`::Granted request
>Thread-34::DEBUG::2014-08-21 11:33:49,258::task::827::TaskManager.Task::(resourceAcquired) Task=`dfebf332-3d74-4cc6-ba19-03922d240bd9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:33:49,258::task::990::TaskManager.Task::(_decref) Task=`dfebf332-3d74-4cc6-ba19-03922d240bd9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:33:49,287::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:49,287::task::1185::TaskManager.Task::(prepare) Task=`dfebf332-3d74-4cc6-ba19-03922d240bd9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:33:49,288::task::595::TaskManager.Task::(_updateState) Task=`dfebf332-3d74-4cc6-ba19-03922d240bd9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:33:49,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:33:49,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:33:49,289::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:33:49,289::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:33:49,290::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:33:49,290::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:33:49,290::task::990::TaskManager.Task::(_decref) Task=`dfebf332-3d74-4cc6-ba19-03922d240bd9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:33:49,386::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:33:49,403::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000565783 s, 880 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:50,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:50,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.153134 s, 6.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:52,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:52,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.522167 s, 2.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:33:54,912::task::595::TaskManager.Task::(_updateState) Task=`a4de92f4-a8de-450b-9372-c0bbe6164d96`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:33:54,913::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:33:54,914::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565783', 'lastCheck': '5.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:33:54,914::task::1185::TaskManager.Task::(prepare) Task=`a4de92f4-a8de-450b-9372-c0bbe6164d96`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565783', 'lastCheck': '5.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:33:54,915::task::595::TaskManager.Task::(_updateState) Task=`a4de92f4-a8de-450b-9372-c0bbe6164d96`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:33:54,915::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:33:54,915::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:33:54,916::task::990::TaskManager.Task::(_decref) Task=`a4de92f4-a8de-450b-9372-c0bbe6164d96`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:33:54,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:55,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.188553 s, 5.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:33:57,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:33:57,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.065449 s, 15.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:33:59,396::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-26::DEBUG::2014-08-21 11:33:59,405::task::595::TaskManager.Task::(_updateState) Task=`59eda024-4ea8-402e-8a37-0b603e7494c7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:33:59,409::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:33:59,412::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:59,453::task::1185::TaskManager.Task::(prepare) Task=`59eda024-4ea8-402e-8a37-0b603e7494c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:33:59,485::task::595::TaskManager.Task::(_updateState) Task=`59eda024-4ea8-402e-8a37-0b603e7494c7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:33:59,485::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:33:59,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:33:59,510::task::990::TaskManager.Task::(_decref) Task=`59eda024-4ea8-402e-8a37-0b603e7494c7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:33:59,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:34:00,082::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 11:34:00,174::task::595::TaskManager.Task::(_updateState) Task=`cdeeb162-353c-4a80-a4e4-763a896d7785`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:34:00,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:34:00,176::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`75fb2ea4-c1e3-477f-a5fb-e165f57294f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:34:00,176::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:34:00,177::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:34:00,177::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`75fb2ea4-c1e3-477f-a5fb-e165f57294f4`::Granted request
>Thread-34::DEBUG::2014-08-21 11:34:00,178::task::827::TaskManager.Task::(resourceAcquired) Task=`cdeeb162-353c-4a80-a4e4-763a896d7785`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:34:00,178::task::990::TaskManager.Task::(_decref) Task=`cdeeb162-353c-4a80-a4e4-763a896d7785`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:34:00,343::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:00,344::task::1185::TaskManager.Task::(prepare) Task=`cdeeb162-353c-4a80-a4e4-763a896d7785`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:00,344::task::595::TaskManager.Task::(_updateState) Task=`cdeeb162-353c-4a80-a4e4-763a896d7785`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:34:00,345::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:34:00,345::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:34:00,345::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:34:00,346::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:34:00,346::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:34:00,346::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:34:00,347::task::990::TaskManager.Task::(_decref) Task=`cdeeb162-353c-4a80-a4e4-763a896d7785`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:34:00,431::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:34:00,465::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00347374 s, 143 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:01,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.987612 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:03,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:03,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467125 s, 21.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:06,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:34:11,621::task::595::TaskManager.Task::(_updateState) Task=`35ae11cc-4cdf-402f-9232-e22988d08f3e`::moving from state init -> state preparing
>Dummy-33::DEBUG::2014-08-21 11:34:11,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.66836 s, 279 kB/s\n'; <rc> = 0
>Thread-13::INFO::2014-08-21 11:34:12,291::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::DEBUG::2014-08-21 11:34:12,386::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-26::DEBUG::2014-08-21 11:34:12,796::task::595::TaskManager.Task::(_updateState) Task=`cf263b2c-d61a-4ad9-98bb-d3f2333909ed`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:34:12,982::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:34:13,005::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::INFO::2014-08-21 11:34:12,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00347374', 'lastCheck': '11.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:34:13,079::task::1185::TaskManager.Task::(prepare) Task=`cf263b2c-d61a-4ad9-98bb-d3f2333909ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:34:13,111::task::1185::TaskManager.Task::(prepare) Task=`35ae11cc-4cdf-402f-9232-e22988d08f3e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00347374', 'lastCheck': '11.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:34:13,137::task::595::TaskManager.Task::(_updateState) Task=`cf263b2c-d61a-4ad9-98bb-d3f2333909ed`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:34:13,151::task::595::TaskManager.Task::(_updateState) Task=`35ae11cc-4cdf-402f-9232-e22988d08f3e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:34:13,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:34:13,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:34:13,184::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:34:13,209::task::990::TaskManager.Task::(_decref) Task=`35ae11cc-4cdf-402f-9232-e22988d08f3e`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:34:13,215::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:34:13,216::task::990::TaskManager.Task::(_decref) Task=`cf263b2c-d61a-4ad9-98bb-d3f2333909ed`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:34:13,513::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:34:13,687::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-34::DEBUG::2014-08-21 11:34:13,698::task::595::TaskManager.Task::(_updateState) Task=`2b070104-4420-45be-8e10-5337e1e18efb`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 11:34:13,765::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00350979 s, 142 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:34:13,819::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:34:13,908::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fc9fde33-4618-47d8-9053-24d319b4220c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:34:13,909::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:34:13,911::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:34:13,912::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fc9fde33-4618-47d8-9053-24d319b4220c`::Granted request
>Thread-34::DEBUG::2014-08-21 11:34:13,915::task::827::TaskManager.Task::(resourceAcquired) Task=`2b070104-4420-45be-8e10-5337e1e18efb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:34:13,916::task::990::TaskManager.Task::(_decref) Task=`2b070104-4420-45be-8e10-5337e1e18efb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:34:13,936::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:13,936::task::1185::TaskManager.Task::(prepare) Task=`2b070104-4420-45be-8e10-5337e1e18efb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:13,937::task::595::TaskManager.Task::(_updateState) Task=`2b070104-4420-45be-8e10-5337e1e18efb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:34:13,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:34:13,938::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:34:13,938::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:34:13,939::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:34:13,939::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:34:13,941::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:34:13,941::task::990::TaskManager.Task::(_decref) Task=`2b070104-4420-45be-8e10-5337e1e18efb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:34:14,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:15,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0609448 s, 16.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:17,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:18,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.275954 s, 3.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:20,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:20,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0858395 s, 11.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:22,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:23,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.407683 s, 2.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:34:23,961::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:34:24,105::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-13::DEBUG::2014-08-21 11:34:24,107::task::595::TaskManager.Task::(_updateState) Task=`ff501479-82e5-41a3-9e57-12197f6d5f0e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:34:24,107::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:34:24,108::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:34:24,108::task::1185::TaskManager.Task::(prepare) Task=`ff501479-82e5-41a3-9e57-12197f6d5f0e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:34:24,109::task::595::TaskManager.Task::(_updateState) Task=`ff501479-82e5-41a3-9e57-12197f6d5f0e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:34:24,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:34:24,110::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:34:24,110::task::990::TaskManager.Task::(_decref) Task=`ff501479-82e5-41a3-9e57-12197f6d5f0e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:34:24,137::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-34::DEBUG::2014-08-21 11:34:24,138::task::595::TaskManager.Task::(_updateState) Task=`99d7b31a-e652-43b3-8ccd-79fa2921f15e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:34:24,138::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:34:24,139::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1033dcd-a0bb-4c37-acad-59996d241538`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:34:24,140::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:34:24,151::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:34:24,152::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b1033dcd-a0bb-4c37-acad-59996d241538`::Granted request
>Thread-34::DEBUG::2014-08-21 11:34:24,153::task::827::TaskManager.Task::(resourceAcquired) Task=`99d7b31a-e652-43b3-8ccd-79fa2921f15e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:34:24,154::task::990::TaskManager.Task::(_decref) Task=`99d7b31a-e652-43b3-8ccd-79fa2921f15e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:34:24,215::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:24,215::task::1185::TaskManager.Task::(prepare) Task=`99d7b31a-e652-43b3-8ccd-79fa2921f15e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:24,216::task::595::TaskManager.Task::(_updateState) Task=`99d7b31a-e652-43b3-8ccd-79fa2921f15e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:34:24,217::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:34:24,218::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:34:24,230::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:34:24,238::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:34:24,239::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:34:24,239::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:34:24,240::task::990::TaskManager.Task::(_decref) Task=`99d7b31a-e652-43b3-8ccd-79fa2921f15e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:34:24,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0914614 s, 5.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:25,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:25,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472813 s, 21.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:27,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:27,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.086122 s, 11.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:34:29,415::task::595::TaskManager.Task::(_updateState) Task=`807ad5a5-4ceb-4f7b-8b01-4263c5e48d37`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:34:29,416::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:34:29,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0914614', 'lastCheck': '4.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:34:29,417::task::1185::TaskManager.Task::(prepare) Task=`807ad5a5-4ceb-4f7b-8b01-4263c5e48d37`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0914614', 'lastCheck': '4.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:34:29,417::task::595::TaskManager.Task::(_updateState) Task=`807ad5a5-4ceb-4f7b-8b01-4263c5e48d37`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:34:29,418::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:34:29,418::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:34:29,418::task::990::TaskManager.Task::(_decref) Task=`807ad5a5-4ceb-4f7b-8b01-4263c5e48d37`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:34:29,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:30,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0672856 s, 15.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:32,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:32,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0626647 s, 16.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:34,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:34,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398148 s, 25.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:34:34,363::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-13::DEBUG::2014-08-21 11:34:34,365::task::595::TaskManager.Task::(_updateState) Task=`b4600955-f2c2-4c69-91a2-80cb0087f2a5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:34:34,365::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:34:34,366::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:34:34,367::task::1185::TaskManager.Task::(prepare) Task=`b4600955-f2c2-4c69-91a2-80cb0087f2a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:34:34,367::task::595::TaskManager.Task::(_updateState) Task=`b4600955-f2c2-4c69-91a2-80cb0087f2a5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:34:34,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:34:34,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:34:34,368::task::990::TaskManager.Task::(_decref) Task=`b4600955-f2c2-4c69-91a2-80cb0087f2a5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:34:34,372::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-34::DEBUG::2014-08-21 11:34:34,373::task::595::TaskManager.Task::(_updateState) Task=`061281d6-7e1a-47b0-9db2-459c7d05c29e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:34:34,373::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:34:34,373::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e6704f55-333c-4eb5-b51b-e85fcb6eb992`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:34:34,374::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:34:34,374::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:34:34,375::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e6704f55-333c-4eb5-b51b-e85fcb6eb992`::Granted request
>Thread-34::DEBUG::2014-08-21 11:34:34,375::task::827::TaskManager.Task::(resourceAcquired) Task=`061281d6-7e1a-47b0-9db2-459c7d05c29e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:34:34,375::task::990::TaskManager.Task::(_decref) Task=`061281d6-7e1a-47b0-9db2-459c7d05c29e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:34:34,380::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:34,380::task::1185::TaskManager.Task::(prepare) Task=`061281d6-7e1a-47b0-9db2-459c7d05c29e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:34,381::task::595::TaskManager.Task::(_updateState) Task=`061281d6-7e1a-47b0-9db2-459c7d05c29e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:34:34,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:34:34,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:34:34,381::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:34:34,382::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:34:34,382::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:34:34,382::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:34:34,382::task::990::TaskManager.Task::(_decref) Task=`061281d6-7e1a-47b0-9db2-459c7d05c29e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:34:34,590::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:34:34,610::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00100039 s, 498 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:36,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:36,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048567 s, 21.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:38,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:38,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501284 s, 20.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:40,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:40,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0695439 s, 14.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:42,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:42,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430925 s, 23.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:34:44,407::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-13::DEBUG::2014-08-21 11:34:44,411::task::595::TaskManager.Task::(_updateState) Task=`2290d95c-6f5f-4e2d-9a0a-41878d3506b0`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:34:44,415::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:34:44,415::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:34:44,416::task::1185::TaskManager.Task::(prepare) Task=`2290d95c-6f5f-4e2d-9a0a-41878d3506b0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:34:44,416::task::595::TaskManager.Task::(_updateState) Task=`2290d95c-6f5f-4e2d-9a0a-41878d3506b0`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:34:44,416::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:34:44,417::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:34:44,417::task::990::TaskManager.Task::(_decref) Task=`2290d95c-6f5f-4e2d-9a0a-41878d3506b0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:34:44,424::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-34::DEBUG::2014-08-21 11:34:44,424::task::595::TaskManager.Task::(_updateState) Task=`e1fdb784-2f0f-4833-a706-6d204b5ec6db`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:34:44,425::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:34:44,426::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`89013905-f19c-4357-8f7e-ba46b85ec743`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:34:44,426::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:34:44,427::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:34:44,427::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`89013905-f19c-4357-8f7e-ba46b85ec743`::Granted request
>Thread-34::DEBUG::2014-08-21 11:34:44,427::task::827::TaskManager.Task::(resourceAcquired) Task=`e1fdb784-2f0f-4833-a706-6d204b5ec6db`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:34:44,428::task::990::TaskManager.Task::(_decref) Task=`e1fdb784-2f0f-4833-a706-6d204b5ec6db`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:34:44,441::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:44,442::task::1185::TaskManager.Task::(prepare) Task=`e1fdb784-2f0f-4833-a706-6d204b5ec6db`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:44,442::task::595::TaskManager.Task::(_updateState) Task=`e1fdb784-2f0f-4833-a706-6d204b5ec6db`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:34:44,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:34:44,443::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:34:44,443::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:34:44,444::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:34:44,444::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:34:44,444::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:34:44,444::task::990::TaskManager.Task::(_decref) Task=`e1fdb784-2f0f-4833-a706-6d204b5ec6db`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:34:44,617::task::595::TaskManager.Task::(_updateState) Task=`cce1846e-eb8a-4f88-8107-fd42f8de67f7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:34:44,618::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:34:44,618::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100039', 'lastCheck': '10.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:34:44,619::task::1185::TaskManager.Task::(prepare) Task=`cce1846e-eb8a-4f88-8107-fd42f8de67f7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100039', 'lastCheck': '10.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:34:44,619::task::595::TaskManager.Task::(_updateState) Task=`cce1846e-eb8a-4f88-8107-fd42f8de67f7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:34:44,619::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:34:44,620::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:34:44,620::task::990::TaskManager.Task::(_decref) Task=`cce1846e-eb8a-4f88-8107-fd42f8de67f7`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:34:44,704::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:34:44,733::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000815539 s, 611 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:45,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:45,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.282891 s, 3.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:47,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:47,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.081773 s, 12.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:49,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:49,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.155021 s, 6.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:51,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:54,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.16217 s, 881 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:34:54,482::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Thread-13::DEBUG::2014-08-21 11:34:54,483::task::595::TaskManager.Task::(_updateState) Task=`5d8b1519-2404-4adb-b2b8-d90302a1ea77`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:34:54,484::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:34:54,484::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:34:54,485::task::1185::TaskManager.Task::(prepare) Task=`5d8b1519-2404-4adb-b2b8-d90302a1ea77`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:34:54,485::task::595::TaskManager.Task::(_updateState) Task=`5d8b1519-2404-4adb-b2b8-d90302a1ea77`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:34:54,485::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:34:54,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:34:54,486::task::990::TaskManager.Task::(_decref) Task=`5d8b1519-2404-4adb-b2b8-d90302a1ea77`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:34:54,507::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [19ce3280]
>Thread-34::DEBUG::2014-08-21 11:34:54,508::task::595::TaskManager.Task::(_updateState) Task=`be165281-2ddd-49cf-9f7a-bdf29045d0ab`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:34:54,509::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:34:54,510::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8d58db45-337d-4125-872e-b87fcadae083`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:34:54,510::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:34:54,511::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:34:54,511::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8d58db45-337d-4125-872e-b87fcadae083`::Granted request
>Thread-34::DEBUG::2014-08-21 11:34:54,512::task::827::TaskManager.Task::(resourceAcquired) Task=`be165281-2ddd-49cf-9f7a-bdf29045d0ab`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:34:54,512::task::990::TaskManager.Task::(_decref) Task=`be165281-2ddd-49cf-9f7a-bdf29045d0ab`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:34:54,518::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:54,519::task::1185::TaskManager.Task::(prepare) Task=`be165281-2ddd-49cf-9f7a-bdf29045d0ab`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:34:54,519::task::595::TaskManager.Task::(_updateState) Task=`be165281-2ddd-49cf-9f7a-bdf29045d0ab`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:34:54,519::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:34:54,520::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:34:54,567::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:34:54,568::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:34:54,573::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:34:54,574::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:34:54,574::task::990::TaskManager.Task::(_decref) Task=`be165281-2ddd-49cf-9f7a-bdf29045d0ab`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:34:54,789::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:34:55,003::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00260951 s, 191 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:56,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:57,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.474541 s, 2.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:34:59,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:34:59,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.30522 s, 3.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:35:00,294::task::595::TaskManager.Task::(_updateState) Task=`0dd3f317-087a-480f-91cb-65cc4f7a46a9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:35:00,295::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:35:00,296::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00260951', 'lastCheck': '5.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:35:00,296::task::1185::TaskManager.Task::(prepare) Task=`0dd3f317-087a-480f-91cb-65cc4f7a46a9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00260951', 'lastCheck': '5.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:35:00,297::task::595::TaskManager.Task::(_updateState) Task=`0dd3f317-087a-480f-91cb-65cc4f7a46a9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:35:00,297::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:35:00,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:35:00,298::task::990::TaskManager.Task::(_decref) Task=`0dd3f317-087a-480f-91cb-65cc4f7a46a9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:35:01,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:01,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0670157 s, 15.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:03,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:35:04,697::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-13::DEBUG::2014-08-21 11:35:04,701::task::595::TaskManager.Task::(_updateState) Task=`e72f1870-9f58-45bb-9363-6200a7c1ec4b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:35:04,791::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:35:04,793::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:35:04,794::task::1185::TaskManager.Task::(prepare) Task=`e72f1870-9f58-45bb-9363-6200a7c1ec4b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:35:04,795::task::595::TaskManager.Task::(_updateState) Task=`e72f1870-9f58-45bb-9363-6200a7c1ec4b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:35:04,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:35:04,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:35:04,796::task::990::TaskManager.Task::(_decref) Task=`e72f1870-9f58-45bb-9363-6200a7c1ec4b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:35:04,828::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 11:35:04,829::task::595::TaskManager.Task::(_updateState) Task=`d0bc2105-a7dd-4ddb-88c6-3ae6d83a6b79`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:35:04,830::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:35:04,831::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f6fb43b9-34c6-4fe4-83b7-61f436f5b693`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:35:04,831::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:35:04,832::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:35:04,832::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f6fb43b9-34c6-4fe4-83b7-61f436f5b693`::Granted request
>Thread-34::DEBUG::2014-08-21 11:35:04,871::task::827::TaskManager.Task::(resourceAcquired) Task=`d0bc2105-a7dd-4ddb-88c6-3ae6d83a6b79`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:35:04,872::task::990::TaskManager.Task::(_decref) Task=`d0bc2105-a7dd-4ddb-88c6-3ae6d83a6b79`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:35:04,881::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:04,881::task::1185::TaskManager.Task::(prepare) Task=`d0bc2105-a7dd-4ddb-88c6-3ae6d83a6b79`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:04,882::task::595::TaskManager.Task::(_updateState) Task=`d0bc2105-a7dd-4ddb-88c6-3ae6d83a6b79`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:35:04,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:35:04,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:35:04,885::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:35:04,885::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:35:04,886::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:35:04,886::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:35:04,887::task::990::TaskManager.Task::(_decref) Task=`d0bc2105-a7dd-4ddb-88c6-3ae6d83a6b79`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:35:04,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.03118 s, 993 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:35:05,049::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:35:05,061::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000473021 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:06,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:07,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0528647 s, 19.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:09,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:09,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395455 s, 25.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:11,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:11,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.114911 s, 8.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:13,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:35:19,086::task::595::TaskManager.Task::(_updateState) Task=`c14e931e-aec1-4697-a9a7-4cea61d1d201`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:35:19,088::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:35:19,088::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473021', 'lastCheck': '14.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:35:19,089::task::1185::TaskManager.Task::(prepare) Task=`c14e931e-aec1-4697-a9a7-4cea61d1d201`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473021', 'lastCheck': '14.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:35:19,089::task::595::TaskManager.Task::(_updateState) Task=`c14e931e-aec1-4697-a9a7-4cea61d1d201`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:35:19,089::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:35:19,090::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:35:19,090::task::990::TaskManager.Task::(_decref) Task=`c14e931e-aec1-4697-a9a7-4cea61d1d201`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:35:19,097::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-13::DEBUG::2014-08-21 11:35:19,098::task::595::TaskManager.Task::(_updateState) Task=`1b674f83-cba0-48c5-9bb6-6ab0652871bb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:35:19,098::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:35:19,099::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:35:19,099::task::1185::TaskManager.Task::(prepare) Task=`1b674f83-cba0-48c5-9bb6-6ab0652871bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:35:19,099::task::595::TaskManager.Task::(_updateState) Task=`1b674f83-cba0-48c5-9bb6-6ab0652871bb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:35:19,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:35:19,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:35:19,100::task::990::TaskManager.Task::(_decref) Task=`1b674f83-cba0-48c5-9bb6-6ab0652871bb`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:35:19,172::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-34::DEBUG::2014-08-21 11:35:19,175::task::595::TaskManager.Task::(_updateState) Task=`d22d5d83-92b8-4a3f-a604-01ada8b7f7a6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:35:19,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:35:19,179::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`719106d8-1761-4cb9-832d-51ba6ad1b541`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:35:19,179::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:35:19,180::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:35:19,180::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`719106d8-1761-4cb9-832d-51ba6ad1b541`::Granted request
>Thread-34::DEBUG::2014-08-21 11:35:19,181::task::827::TaskManager.Task::(resourceAcquired) Task=`d22d5d83-92b8-4a3f-a604-01ada8b7f7a6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:35:19,181::task::990::TaskManager.Task::(_decref) Task=`d22d5d83-92b8-4a3f-a604-01ada8b7f7a6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:35:19,188::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:19,188::task::1185::TaskManager.Task::(prepare) Task=`d22d5d83-92b8-4a3f-a604-01ada8b7f7a6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:19,189::task::595::TaskManager.Task::(_updateState) Task=`d22d5d83-92b8-4a3f-a604-01ada8b7f7a6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:35:19,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:35:19,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:35:19,190::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:35:19,190::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:35:19,190::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:35:19,190::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:35:19,191::task::990::TaskManager.Task::(_decref) Task=`d22d5d83-92b8-4a3f-a604-01ada8b7f7a6`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:35:19,239::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:35:19,277::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00665194 s, 74.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:19,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.32804 s, 192 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:21,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:22,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.495604 s, 2.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:24,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:24,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.351094 s, 2.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:26,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:28,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.70742 s, 600 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:35:29,287::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-26::DEBUG::2014-08-21 11:35:29,289::task::595::TaskManager.Task::(_updateState) Task=`fc20c4af-5abc-4c89-985b-8617a7667e6d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:35:29,289::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:35:29,290::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:35:29,290::task::1185::TaskManager.Task::(prepare) Task=`fc20c4af-5abc-4c89-985b-8617a7667e6d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:35:29,291::task::595::TaskManager.Task::(_updateState) Task=`fc20c4af-5abc-4c89-985b-8617a7667e6d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:35:29,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:35:29,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:35:29,291::task::990::TaskManager.Task::(_decref) Task=`fc20c4af-5abc-4c89-985b-8617a7667e6d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:35:29,297::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-34::DEBUG::2014-08-21 11:35:29,297::task::595::TaskManager.Task::(_updateState) Task=`37f77d85-14b3-42d5-bb98-b58d349083a4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:35:29,298::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:35:29,299::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c2e4b399-df8c-4e39-8d41-9e2c268ad422`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:35:29,299::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:35:29,300::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:35:29,300::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c2e4b399-df8c-4e39-8d41-9e2c268ad422`::Granted request
>Thread-34::DEBUG::2014-08-21 11:35:29,301::task::827::TaskManager.Task::(resourceAcquired) Task=`37f77d85-14b3-42d5-bb98-b58d349083a4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:35:29,301::task::990::TaskManager.Task::(_decref) Task=`37f77d85-14b3-42d5-bb98-b58d349083a4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:35:29,307::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:29,307::task::1185::TaskManager.Task::(prepare) Task=`37f77d85-14b3-42d5-bb98-b58d349083a4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:29,307::task::595::TaskManager.Task::(_updateState) Task=`37f77d85-14b3-42d5-bb98-b58d349083a4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:35:29,308::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:35:29,309::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:35:29,309::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:35:29,310::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:35:29,310::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:35:29,310::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:35:29,311::task::990::TaskManager.Task::(_decref) Task=`37f77d85-14b3-42d5-bb98-b58d349083a4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:35:30,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:30,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0797308 s, 12.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:35:31,282::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:35:31,296::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000780328 s, 638 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:32,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:33,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170547 s, 6.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:35:34,429::task::595::TaskManager.Task::(_updateState) Task=`5c577a00-b8e5-44b0-8b75-a6a19d82245f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:35:34,436::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:35:34,437::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780328', 'lastCheck': '3.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:35:34,437::task::1185::TaskManager.Task::(prepare) Task=`5c577a00-b8e5-44b0-8b75-a6a19d82245f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780328', 'lastCheck': '3.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:35:34,438::task::595::TaskManager.Task::(_updateState) Task=`5c577a00-b8e5-44b0-8b75-a6a19d82245f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:35:34,438::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:35:34,438::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:35:34,439::task::990::TaskManager.Task::(_decref) Task=`5c577a00-b8e5-44b0-8b75-a6a19d82245f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:35:35,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:35,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104439 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:37,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:39,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.78515 s, 574 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:35:39,515::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-26::DEBUG::2014-08-21 11:35:39,519::task::595::TaskManager.Task::(_updateState) Task=`31ab7b53-2ca3-4201-b18b-a3619650ba9a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:35:39,519::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:35:39,520::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:35:39,520::task::1185::TaskManager.Task::(prepare) Task=`31ab7b53-2ca3-4201-b18b-a3619650ba9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:35:39,521::task::595::TaskManager.Task::(_updateState) Task=`31ab7b53-2ca3-4201-b18b-a3619650ba9a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:35:39,521::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:35:39,521::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:35:39,522::task::990::TaskManager.Task::(_decref) Task=`31ab7b53-2ca3-4201-b18b-a3619650ba9a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:35:39,833::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-34::DEBUG::2014-08-21 11:35:39,834::task::595::TaskManager.Task::(_updateState) Task=`eec1197c-460b-40c4-8d3b-c0394f737dd7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:35:39,834::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:35:39,835::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0569f286-52b4-41d7-868c-7f4c5b77d18e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:35:39,836::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:35:39,836::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:35:39,836::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0569f286-52b4-41d7-868c-7f4c5b77d18e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:35:39,837::task::827::TaskManager.Task::(resourceAcquired) Task=`eec1197c-460b-40c4-8d3b-c0394f737dd7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:35:39,838::task::990::TaskManager.Task::(_decref) Task=`eec1197c-460b-40c4-8d3b-c0394f737dd7`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:35:39,875::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:39,876::task::1185::TaskManager.Task::(prepare) Task=`eec1197c-460b-40c4-8d3b-c0394f737dd7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:39,876::task::595::TaskManager.Task::(_updateState) Task=`eec1197c-460b-40c4-8d3b-c0394f737dd7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:35:39,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:35:39,886::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:35:39,888::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:35:39,889::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:35:39,896::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:35:39,897::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:35:39,899::task::990::TaskManager.Task::(_decref) Task=`eec1197c-460b-40c4-8d3b-c0394f737dd7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:35:41,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:35:41,403::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:35:41,433::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000660879 s, 754 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:41,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0607346 s, 16.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:43,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:43,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0954744 s, 10.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:46,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:46,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.120735 s, 8.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:48,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:49,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.140804 s, 7.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:35:49,935::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-26::DEBUG::2014-08-21 11:35:49,936::task::595::TaskManager.Task::(_updateState) Task=`896ca979-9083-4ade-8c92-69aa31293f1d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:35:49,937::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:35:49,937::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:35:49,937::task::1185::TaskManager.Task::(prepare) Task=`896ca979-9083-4ade-8c92-69aa31293f1d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:35:49,938::task::595::TaskManager.Task::(_updateState) Task=`896ca979-9083-4ade-8c92-69aa31293f1d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:35:49,938::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:35:49,938::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:35:49,938::task::990::TaskManager.Task::(_decref) Task=`896ca979-9083-4ade-8c92-69aa31293f1d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:35:49,943::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-34::DEBUG::2014-08-21 11:35:49,943::task::595::TaskManager.Task::(_updateState) Task=`1beefa84-cd2c-4ea9-9c72-25305d4a95f6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:35:49,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:35:49,947::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fc2744d4-f9a3-48ea-ba14-80f63b5080b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:35:49,947::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:35:49,948::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:35:49,948::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fc2744d4-f9a3-48ea-ba14-80f63b5080b5`::Granted request
>Thread-34::DEBUG::2014-08-21 11:35:49,949::task::827::TaskManager.Task::(resourceAcquired) Task=`1beefa84-cd2c-4ea9-9c72-25305d4a95f6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:35:49,949::task::990::TaskManager.Task::(_decref) Task=`1beefa84-cd2c-4ea9-9c72-25305d4a95f6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:35:49,954::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:49,955::task::1185::TaskManager.Task::(prepare) Task=`1beefa84-cd2c-4ea9-9c72-25305d4a95f6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:35:49,955::task::595::TaskManager.Task::(_updateState) Task=`1beefa84-cd2c-4ea9-9c72-25305d4a95f6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:35:49,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:35:49,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:35:49,957::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:35:49,957::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:35:49,957::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:35:49,958::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:35:49,958::task::990::TaskManager.Task::(_decref) Task=`1beefa84-cd2c-4ea9-9c72-25305d4a95f6`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:35:50,437::task::595::TaskManager.Task::(_updateState) Task=`79eed28e-d4b0-4168-9844-81b16cbc4ced`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:35:50,437::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:35:50,438::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660879', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:35:50,438::task::1185::TaskManager.Task::(prepare) Task=`79eed28e-d4b0-4168-9844-81b16cbc4ced`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660879', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:35:50,438::task::595::TaskManager.Task::(_updateState) Task=`79eed28e-d4b0-4168-9844-81b16cbc4ced`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:35:50,438::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:35:50,439::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:35:50,439::task::990::TaskManager.Task::(_decref) Task=`79eed28e-d4b0-4168-9844-81b16cbc4ced`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:35:51,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:51,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.261783 s, 3.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:35:51,505::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:35:51,518::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000511452 s, 974 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:53,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:53,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0832939 s, 12.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:55,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:56,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.553799 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:35:58,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:35:58,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105402 s, 9.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:36:00,000::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-26::DEBUG::2014-08-21 11:36:00,002::task::595::TaskManager.Task::(_updateState) Task=`2027653e-98c3-43b4-9f2a-4f84d42a74bc`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:36:00,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:36:00,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:00,003::task::1185::TaskManager.Task::(prepare) Task=`2027653e-98c3-43b4-9f2a-4f84d42a74bc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:00,004::task::595::TaskManager.Task::(_updateState) Task=`2027653e-98c3-43b4-9f2a-4f84d42a74bc`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:36:00,004::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:36:00,004::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:36:00,005::task::990::TaskManager.Task::(_decref) Task=`2027653e-98c3-43b4-9f2a-4f84d42a74bc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:36:00,011::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-34::DEBUG::2014-08-21 11:36:00,011::task::595::TaskManager.Task::(_updateState) Task=`001b6ee6-639b-48c2-b51b-2534c8c89d99`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:36:00,012::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:36:00,013::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9398c96f-94f2-421b-83ed-6f3a96d1cdc6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:36:00,013::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:36:00,014::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:36:00,014::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9398c96f-94f2-421b-83ed-6f3a96d1cdc6`::Granted request
>Thread-34::DEBUG::2014-08-21 11:36:00,015::task::827::TaskManager.Task::(resourceAcquired) Task=`001b6ee6-639b-48c2-b51b-2534c8c89d99`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:36:00,015::task::990::TaskManager.Task::(_decref) Task=`001b6ee6-639b-48c2-b51b-2534c8c89d99`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:36:00,020::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:00,021::task::1185::TaskManager.Task::(prepare) Task=`001b6ee6-639b-48c2-b51b-2534c8c89d99`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:00,021::task::595::TaskManager.Task::(_updateState) Task=`001b6ee6-639b-48c2-b51b-2534c8c89d99`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:36:00,022::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:36:00,022::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:36:00,022::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:36:00,023::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:36:00,023::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:36:00,023::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:36:00,024::task::990::TaskManager.Task::(_decref) Task=`001b6ee6-639b-48c2-b51b-2534c8c89d99`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:36:00,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:00,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0601838 s, 17.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:36:01,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:36:01,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000415863 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:02,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:02,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483232 s, 21.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:04,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:05,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.084926 s, 12.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:36:05,589::task::595::TaskManager.Task::(_updateState) Task=`04b814b3-49ab-4730-8fde-c209f9945197`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:36:05,590::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:36:05,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415863', 'lastCheck': '4.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:36:05,591::task::1185::TaskManager.Task::(prepare) Task=`04b814b3-49ab-4730-8fde-c209f9945197`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415863', 'lastCheck': '4.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:36:05,591::task::595::TaskManager.Task::(_updateState) Task=`04b814b3-49ab-4730-8fde-c209f9945197`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:36:05,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:36:05,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:36:05,592::task::990::TaskManager.Task::(_decref) Task=`04b814b3-49ab-4730-8fde-c209f9945197`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:36:07,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:07,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.27617 s, 3.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:09,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:09,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.261266 s, 3.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:36:10,056::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-26::DEBUG::2014-08-21 11:36:10,057::task::595::TaskManager.Task::(_updateState) Task=`e6850faa-89c6-4e29-939e-2164f3e781c0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:36:10,058::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:36:10,059::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:10,059::task::1185::TaskManager.Task::(prepare) Task=`e6850faa-89c6-4e29-939e-2164f3e781c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:10,060::task::595::TaskManager.Task::(_updateState) Task=`e6850faa-89c6-4e29-939e-2164f3e781c0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:36:10,060::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:36:10,060::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:36:10,061::task::990::TaskManager.Task::(_decref) Task=`e6850faa-89c6-4e29-939e-2164f3e781c0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:36:10,067::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-34::DEBUG::2014-08-21 11:36:10,067::task::595::TaskManager.Task::(_updateState) Task=`1c71d0d0-1621-4828-af92-4794367ff692`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:36:10,067::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:36:10,068::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`97a59479-b510-472a-9f48-337d818e08ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:36:10,068::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:36:10,069::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:36:10,069::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`97a59479-b510-472a-9f48-337d818e08ae`::Granted request
>Thread-34::DEBUG::2014-08-21 11:36:10,070::task::827::TaskManager.Task::(resourceAcquired) Task=`1c71d0d0-1621-4828-af92-4794367ff692`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:36:10,070::task::990::TaskManager.Task::(_decref) Task=`1c71d0d0-1621-4828-af92-4794367ff692`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:36:10,075::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:10,076::task::1185::TaskManager.Task::(prepare) Task=`1c71d0d0-1621-4828-af92-4794367ff692`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:10,076::task::595::TaskManager.Task::(_updateState) Task=`1c71d0d0-1621-4828-af92-4794367ff692`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:36:10,076::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:36:10,076::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:36:10,077::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:36:10,077::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:36:10,077::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:36:10,077::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:36:10,078::task::990::TaskManager.Task::(_decref) Task=`1c71d0d0-1621-4828-af92-4794367ff692`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:36:11,579::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:36:11,632::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000622067 s, 801 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:12,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:12,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0533828 s, 19.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:14,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:14,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0802299 s, 12.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:16,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:18,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.20428 s, 850 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:36:20,093::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-26::DEBUG::2014-08-21 11:36:20,094::task::595::TaskManager.Task::(_updateState) Task=`59be4dd0-453c-4dfa-9989-7b4cb36cde28`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:36:20,095::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:36:20,097::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:20,098::task::1185::TaskManager.Task::(prepare) Task=`59be4dd0-453c-4dfa-9989-7b4cb36cde28`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:20,098::task::595::TaskManager.Task::(_updateState) Task=`59be4dd0-453c-4dfa-9989-7b4cb36cde28`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:36:20,099::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:36:20,099::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:36:20,100::task::990::TaskManager.Task::(_decref) Task=`59be4dd0-453c-4dfa-9989-7b4cb36cde28`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:36:20,108::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eb71a61]
>Thread-34::DEBUG::2014-08-21 11:36:20,127::task::595::TaskManager.Task::(_updateState) Task=`cd817ed6-c673-4d72-b4f5-de67dff82293`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:36:20,130::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:36:20,137::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e58f9e2a-1df0-4629-8840-0b6635eaddce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:36:20,139::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:36:20,140::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:36:20,140::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e58f9e2a-1df0-4629-8840-0b6635eaddce`::Granted request
>Thread-34::DEBUG::2014-08-21 11:36:20,145::task::827::TaskManager.Task::(resourceAcquired) Task=`cd817ed6-c673-4d72-b4f5-de67dff82293`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:36:20,149::task::990::TaskManager.Task::(_decref) Task=`cd817ed6-c673-4d72-b4f5-de67dff82293`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:36:20,213::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:20,214::task::1185::TaskManager.Task::(prepare) Task=`cd817ed6-c673-4d72-b4f5-de67dff82293`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:20,215::task::595::TaskManager.Task::(_updateState) Task=`cd817ed6-c673-4d72-b4f5-de67dff82293`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:36:20,219::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:36:20,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:36:20,226::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:36:20,227::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:36:20,230::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:36:20,230::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:36:20,233::task::990::TaskManager.Task::(_decref) Task=`cd817ed6-c673-4d72-b4f5-de67dff82293`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:36:20,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:36:22,224::task::595::TaskManager.Task::(_updateState) Task=`ac3ab180-a46e-4f0e-ab26-49da3f713ce6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:36:22,225::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:36:22,225::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622067', 'lastCheck': '10.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:36:22,226::task::1185::TaskManager.Task::(prepare) Task=`ac3ab180-a46e-4f0e-ab26-49da3f713ce6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622067', 'lastCheck': '10.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:36:22,405::task::595::TaskManager.Task::(_updateState) Task=`ac3ab180-a46e-4f0e-ab26-49da3f713ce6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:36:22,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:36:22,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:36:22,718::task::990::TaskManager.Task::(_decref) Task=`ac3ab180-a46e-4f0e-ab26-49da3f713ce6`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:36:23,167::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:36:23,228::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00268734 s, 185 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:23,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.285832 s, 3.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:25,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:27,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.91987 s, 533 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:30,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:36:30,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [ffadda0]
>Thread-26::DEBUG::2014-08-21 11:36:30,324::task::595::TaskManager.Task::(_updateState) Task=`668bc6e7-5b58-484a-9b25-f1e63d32e40a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:36:30,386::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:36:30,387::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:30,388::task::1185::TaskManager.Task::(prepare) Task=`668bc6e7-5b58-484a-9b25-f1e63d32e40a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:30,389::task::595::TaskManager.Task::(_updateState) Task=`668bc6e7-5b58-484a-9b25-f1e63d32e40a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:36:30,389::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:36:30,390::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:36:30,390::task::990::TaskManager.Task::(_decref) Task=`668bc6e7-5b58-484a-9b25-f1e63d32e40a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:36:30,451::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [ffadda0]
>Thread-34::DEBUG::2014-08-21 11:36:30,452::task::595::TaskManager.Task::(_updateState) Task=`015e14ca-fc98-495e-8fd1-8e1186ce918c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:36:30,453::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:36:30,453::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`04e9dbb0-668f-4f33-8e12-a50773667915`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:36:30,453::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:36:30,454::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:36:30,454::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`04e9dbb0-668f-4f33-8e12-a50773667915`::Granted request
>Thread-34::DEBUG::2014-08-21 11:36:30,455::task::827::TaskManager.Task::(resourceAcquired) Task=`015e14ca-fc98-495e-8fd1-8e1186ce918c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:36:30,455::task::990::TaskManager.Task::(_decref) Task=`015e14ca-fc98-495e-8fd1-8e1186ce918c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:36:30,459::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:30,459::task::1185::TaskManager.Task::(prepare) Task=`015e14ca-fc98-495e-8fd1-8e1186ce918c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:30,459::task::595::TaskManager.Task::(_updateState) Task=`015e14ca-fc98-495e-8fd1-8e1186ce918c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:36:30,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:36:30,460::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:36:30,460::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:36:30,460::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:36:30,460::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:36:30,460::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:36:30,461::task::990::TaskManager.Task::(_decref) Task=`015e14ca-fc98-495e-8fd1-8e1186ce918c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:36:30,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.38862 s, 2.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:32,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:32,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0516732 s, 19.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:36:33,271::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:36:33,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000847246 s, 588 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:34,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:36,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.78113 s, 575 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:38,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:38,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0420995 s, 24.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:36:38,911::task::595::TaskManager.Task::(_updateState) Task=`13f5ef6b-b9d3-440c-a1e2-aff042cc6ad7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:36:38,912::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:36:38,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000847246', 'lastCheck': '5.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:36:38,913::task::1185::TaskManager.Task::(prepare) Task=`13f5ef6b-b9d3-440c-a1e2-aff042cc6ad7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000847246', 'lastCheck': '5.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:36:38,914::task::595::TaskManager.Task::(_updateState) Task=`13f5ef6b-b9d3-440c-a1e2-aff042cc6ad7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:36:38,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:36:38,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:36:38,915::task::990::TaskManager.Task::(_decref) Task=`13f5ef6b-b9d3-440c-a1e2-aff042cc6ad7`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:36:40,484::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-26::DEBUG::2014-08-21 11:36:40,485::task::595::TaskManager.Task::(_updateState) Task=`99c194f8-1a43-49ba-bba6-d7a3f6af802b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:36:40,486::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:36:40,487::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:40,487::task::1185::TaskManager.Task::(prepare) Task=`99c194f8-1a43-49ba-bba6-d7a3f6af802b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:36:40,488::task::595::TaskManager.Task::(_updateState) Task=`99c194f8-1a43-49ba-bba6-d7a3f6af802b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:36:40,488::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:36:40,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:36:40,489::task::990::TaskManager.Task::(_decref) Task=`99c194f8-1a43-49ba-bba6-d7a3f6af802b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:36:56,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:36:56,483::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-34::DEBUG::2014-08-21 11:36:56,484::task::595::TaskManager.Task::(_updateState) Task=`2c0d502f-e547-4cbf-8b6a-ab66c12ea3f2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:36:56,485::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:36:56,486::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5e2d395a-79c5-4559-bc2d-d72a3a7ad2a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:36:56,486::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:36:56,498::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:36:56,561::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5e2d395a-79c5-4559-bc2d-d72a3a7ad2a6`::Granted request
>Thread-34::DEBUG::2014-08-21 11:36:56,573::task::827::TaskManager.Task::(resourceAcquired) Task=`2c0d502f-e547-4cbf-8b6a-ab66c12ea3f2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:36:56,574::task::990::TaskManager.Task::(_decref) Task=`2c0d502f-e547-4cbf-8b6a-ab66c12ea3f2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:36:56,660::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:56,663::task::1185::TaskManager.Task::(prepare) Task=`2c0d502f-e547-4cbf-8b6a-ab66c12ea3f2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:36:56,665::task::595::TaskManager.Task::(_updateState) Task=`2c0d502f-e547-4cbf-8b6a-ab66c12ea3f2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:36:56,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:36:56,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:36:56,684::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-15::DEBUG::2014-08-21 11:36:56,689::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:36:56,805::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:36:56,851::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:36:56,856::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:36:56,893::task::990::TaskManager.Task::(_decref) Task=`2c0d502f-e547-4cbf-8b6a-ab66c12ea3f2`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:36:56,929::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00128158 s, 389 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:57,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.766751 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:36:59,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:36:59,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0764041 s, 13.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:01,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:01,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0821257 s, 12.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:03,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:03,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102306 s, 10.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:05,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:05,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0629451 s, 16.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:37:06,952::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-13::DEBUG::2014-08-21 11:37:06,954::task::595::TaskManager.Task::(_updateState) Task=`891b3a92-1f2b-498f-b70d-c5037fb4ac1a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:37:06,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:37:06,955::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:37:06,955::task::1185::TaskManager.Task::(prepare) Task=`891b3a92-1f2b-498f-b70d-c5037fb4ac1a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:37:06,956::task::595::TaskManager.Task::(_updateState) Task=`891b3a92-1f2b-498f-b70d-c5037fb4ac1a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:37:06,956::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:37:06,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:37:06,956::task::990::TaskManager.Task::(_decref) Task=`891b3a92-1f2b-498f-b70d-c5037fb4ac1a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:37:06,962::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 11:37:06,962::task::595::TaskManager.Task::(_updateState) Task=`ecce273f-5190-4c73-a25d-da4d673158fa`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:37:06,963::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:37:06,963::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`79157841-bd4f-4cea-b27b-54fd62a83640`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:37:06,964::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:37:06,964::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:37:06,964::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`79157841-bd4f-4cea-b27b-54fd62a83640`::Granted request
>Thread-34::DEBUG::2014-08-21 11:37:06,965::task::827::TaskManager.Task::(resourceAcquired) Task=`ecce273f-5190-4c73-a25d-da4d673158fa`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:37:06,965::task::990::TaskManager.Task::(_decref) Task=`ecce273f-5190-4c73-a25d-da4d673158fa`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:37:06,970::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:06,970::task::1185::TaskManager.Task::(prepare) Task=`ecce273f-5190-4c73-a25d-da4d673158fa`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:06,970::task::595::TaskManager.Task::(_updateState) Task=`ecce273f-5190-4c73-a25d-da4d673158fa`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:37:06,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:37:06,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:37:06,971::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:37:06,972::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:37:06,972::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:37:06,972::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:37:06,973::task::990::TaskManager.Task::(_decref) Task=`ecce273f-5190-4c73-a25d-da4d673158fa`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:37:07,017::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:37:07,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00190324 s, 262 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:07,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:08,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0783553 s, 13.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:37:09,678::task::595::TaskManager.Task::(_updateState) Task=`5a7f058f-a1ba-40c5-845b-58776ea996a0`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:37:09,678::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:37:09,679::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00190324', 'lastCheck': '2.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:37:09,679::task::1185::TaskManager.Task::(prepare) Task=`5a7f058f-a1ba-40c5-845b-58776ea996a0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00190324', 'lastCheck': '2.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:37:09,680::task::595::TaskManager.Task::(_updateState) Task=`5a7f058f-a1ba-40c5-845b-58776ea996a0`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:37:09,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:37:09,681::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:37:09,681::task::990::TaskManager.Task::(_decref) Task=`5a7f058f-a1ba-40c5-845b-58776ea996a0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:37:10,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:10,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.21037 s, 4.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:12,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:12,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0653343 s, 15.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:14,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:15,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.176966 s, 5.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:37:18,007::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-13::DEBUG::2014-08-21 11:37:18,008::task::595::TaskManager.Task::(_updateState) Task=`ff005523-b593-49b6-8cac-fbaf3c07d930`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:37:18,009::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:37:18,009::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:37:18,009::task::1185::TaskManager.Task::(prepare) Task=`ff005523-b593-49b6-8cac-fbaf3c07d930`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:37:18,010::task::595::TaskManager.Task::(_updateState) Task=`ff005523-b593-49b6-8cac-fbaf3c07d930`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:37:18,010::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:37:18,012::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:37:18,012::task::990::TaskManager.Task::(_decref) Task=`ff005523-b593-49b6-8cac-fbaf3c07d930`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:37:18,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:18,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:37:18,147::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-34::DEBUG::2014-08-21 11:37:18,149::task::595::TaskManager.Task::(_updateState) Task=`32702b01-afc0-423d-bd9e-1966c73c827d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:37:18,150::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:37:18,152::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0d9677db-e946-452e-b31c-c8cf85771698`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:37:18,153::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:37:18,154::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:37:18,154::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0d9677db-e946-452e-b31c-c8cf85771698`::Granted request
>Thread-34::DEBUG::2014-08-21 11:37:18,156::task::827::TaskManager.Task::(resourceAcquired) Task=`32702b01-afc0-423d-bd9e-1966c73c827d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:37:18,156::task::990::TaskManager.Task::(_decref) Task=`32702b01-afc0-423d-bd9e-1966c73c827d`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:37:18,165::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0228433 s, 21.8 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:37:18,274::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:18,275::task::1185::TaskManager.Task::(prepare) Task=`32702b01-afc0-423d-bd9e-1966c73c827d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:18,276::task::595::TaskManager.Task::(_updateState) Task=`32702b01-afc0-423d-bd9e-1966c73c827d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:37:18,281::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:37:18,282::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:37:18,283::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:37:18,283::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:37:18,284::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:37:18,284::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:37:18,294::task::990::TaskManager.Task::(_decref) Task=`32702b01-afc0-423d-bd9e-1966c73c827d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:37:18,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.247219 s, 4.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:20,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:21,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.370938 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:23,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:37:30,612::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-26::DEBUG::2014-08-21 11:37:30,643::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-26::DEBUG::2014-08-21 11:37:30,645::task::595::TaskManager.Task::(_updateState) Task=`2fd95c0c-4de2-4985-a346-82382f38ce9c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:37:30,645::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::DEBUG::2014-08-21 11:37:30,648::task::595::TaskManager.Task::(_updateState) Task=`a435a9df-8fa1-4d99-a2d7-bb7abf13fbf3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:37:30,649::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:37:30,649::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0228433', 'lastCheck': '12.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:37:30,650::task::1185::TaskManager.Task::(prepare) Task=`a435a9df-8fa1-4d99-a2d7-bb7abf13fbf3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0228433', 'lastCheck': '12.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:37:30,650::task::595::TaskManager.Task::(_updateState) Task=`a435a9df-8fa1-4d99-a2d7-bb7abf13fbf3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:37:30,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:37:30,651::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:37:30,651::task::990::TaskManager.Task::(_decref) Task=`a435a9df-8fa1-4d99-a2d7-bb7abf13fbf3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:37:32,453::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:37:32,464::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:37:32,487::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 11:37:32,503::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:37:32,505::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:37:32,507::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-26::INFO::2014-08-21 11:37:32,513::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:37:32,531::task::1185::TaskManager.Task::(prepare) Task=`2fd95c0c-4de2-4985-a346-82382f38ce9c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:37:32,532::task::595::TaskManager.Task::(_updateState) Task=`2fd95c0c-4de2-4985-a346-82382f38ce9c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:37:32,534::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:37:32,535::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:37:32,561::task::990::TaskManager.Task::(_decref) Task=`2fd95c0c-4de2-4985-a346-82382f38ce9c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:37:32,578::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 11:37:32,582::task::595::TaskManager.Task::(_updateState) Task=`b0340112-d601-4211-b49c-7461a5a2ae54`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:37:32,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:37:32,590::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5d967c8c-cfa1-400b-ac79-6910014ee3cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:37:32,592::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:37:32,597::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:37:32,601::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5d967c8c-cfa1-400b-ac79-6910014ee3cd`::Granted request
>Thread-34::DEBUG::2014-08-21 11:37:32,611::task::827::TaskManager.Task::(resourceAcquired) Task=`b0340112-d601-4211-b49c-7461a5a2ae54`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:37:32,617::task::990::TaskManager.Task::(_decref) Task=`b0340112-d601-4211-b49c-7461a5a2ae54`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:37:32,729::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:32,734::task::1185::TaskManager.Task::(prepare) Task=`b0340112-d601-4211-b49c-7461a5a2ae54`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:32,738::task::595::TaskManager.Task::(_updateState) Task=`b0340112-d601-4211-b49c-7461a5a2ae54`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:37:32,744::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:37:32,748::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:37:32,755::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:37:32,763::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:37:32,766::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:37:32,771::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:37:32,779::task::990::TaskManager.Task::(_decref) Task=`b0340112-d601-4211-b49c-7461a5a2ae54`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:37:32,811::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:37:32,881::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00117087 s, 425 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:33,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 9.89606 s, 103 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:35,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:35,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102307 s, 10.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:37,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:37,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0907211 s, 11.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:39,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:39,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.228296 s, 4.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:42,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:42,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0737336 s, 13.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:37:42,829::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-26::DEBUG::2014-08-21 11:37:42,831::task::595::TaskManager.Task::(_updateState) Task=`e815a48e-b06e-46a8-b55a-b189879207d6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:37:42,831::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:37:42,832::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:37:42,832::task::1185::TaskManager.Task::(prepare) Task=`e815a48e-b06e-46a8-b55a-b189879207d6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:37:42,833::task::595::TaskManager.Task::(_updateState) Task=`e815a48e-b06e-46a8-b55a-b189879207d6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:37:42,833::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:37:42,833::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:37:42,834::task::990::TaskManager.Task::(_decref) Task=`e815a48e-b06e-46a8-b55a-b189879207d6`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:37:42,846::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-34::DEBUG::2014-08-21 11:37:42,847::task::595::TaskManager.Task::(_updateState) Task=`32235a89-7adb-4e6e-ab57-576a6cb83cf1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:37:42,847::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:37:42,848::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`83d71471-a1a1-48fa-b076-f667092abf87`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:37:42,849::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:37:42,849::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:37:42,849::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`83d71471-a1a1-48fa-b076-f667092abf87`::Granted request
>Thread-34::DEBUG::2014-08-21 11:37:42,850::task::827::TaskManager.Task::(resourceAcquired) Task=`32235a89-7adb-4e6e-ab57-576a6cb83cf1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:37:42,850::task::990::TaskManager.Task::(_decref) Task=`32235a89-7adb-4e6e-ab57-576a6cb83cf1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:37:42,854::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:42,854::task::1185::TaskManager.Task::(prepare) Task=`32235a89-7adb-4e6e-ab57-576a6cb83cf1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:42,854::task::595::TaskManager.Task::(_updateState) Task=`32235a89-7adb-4e6e-ab57-576a6cb83cf1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:37:42,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:37:42,855::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:37:42,855::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:37:42,856::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:37:42,856::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:37:42,856::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:37:42,856::task::990::TaskManager.Task::(_decref) Task=`32235a89-7adb-4e6e-ab57-576a6cb83cf1`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:37:42,922::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:37:42,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000479324 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:44,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:46,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.61656 s, 391 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:49,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:49,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0654734 s, 15.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:37:49,793::task::595::TaskManager.Task::(_updateState) Task=`db04693c-11c1-43c5-93d6-6906fdf1e44a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:37:49,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:37:49,794::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479324', 'lastCheck': '6.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:37:49,795::task::1185::TaskManager.Task::(prepare) Task=`db04693c-11c1-43c5-93d6-6906fdf1e44a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479324', 'lastCheck': '6.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:37:49,795::task::595::TaskManager.Task::(_updateState) Task=`db04693c-11c1-43c5-93d6-6906fdf1e44a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:37:49,796::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:37:49,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:37:49,796::task::990::TaskManager.Task::(_decref) Task=`db04693c-11c1-43c5-93d6-6906fdf1e44a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:37:51,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:52,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.517738 s, 2.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:37:52,875::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [727d0c40]
>Thread-26::DEBUG::2014-08-21 11:37:52,876::task::595::TaskManager.Task::(_updateState) Task=`6520b038-ee33-4dee-b3a4-58ff35b7711d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:37:52,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:37:52,878::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:37:52,878::task::1185::TaskManager.Task::(prepare) Task=`6520b038-ee33-4dee-b3a4-58ff35b7711d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:37:52,878::task::595::TaskManager.Task::(_updateState) Task=`6520b038-ee33-4dee-b3a4-58ff35b7711d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:37:52,879::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:37:52,879::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:37:52,879::task::990::TaskManager.Task::(_decref) Task=`6520b038-ee33-4dee-b3a4-58ff35b7711d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:37:52,886::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [727d0c40]
>Thread-34::DEBUG::2014-08-21 11:37:52,887::task::595::TaskManager.Task::(_updateState) Task=`195df6b1-e7fa-4c41-bfaa-164a3700245e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:37:52,888::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:37:52,888::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ff4b9d15-68db-4965-9b60-777d0578e430`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:37:52,889::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:37:52,889::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:37:52,890::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ff4b9d15-68db-4965-9b60-777d0578e430`::Granted request
>Thread-34::DEBUG::2014-08-21 11:37:52,890::task::827::TaskManager.Task::(resourceAcquired) Task=`195df6b1-e7fa-4c41-bfaa-164a3700245e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:37:52,891::task::990::TaskManager.Task::(_decref) Task=`195df6b1-e7fa-4c41-bfaa-164a3700245e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:37:52,911::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:52,911::task::1185::TaskManager.Task::(prepare) Task=`195df6b1-e7fa-4c41-bfaa-164a3700245e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:37:52,912::task::595::TaskManager.Task::(_updateState) Task=`195df6b1-e7fa-4c41-bfaa-164a3700245e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:37:52,912::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:37:52,912::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:37:52,913::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:37:52,917::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:37:52,918::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:37:52,918::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:37:52,919::task::990::TaskManager.Task::(_decref) Task=`195df6b1-e7fa-4c41-bfaa-164a3700245e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:37:52,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:37:53,033::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0133951 s, 37.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:54,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:54,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0811757 s, 12.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:37:56,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:37:58,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.277746 s, 3.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:00,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:38:03,023::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-26::DEBUG::2014-08-21 11:38:03,161::task::595::TaskManager.Task::(_updateState) Task=`290d3521-0afe-4ec2-8679-e1bfa005626a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:38:03,162::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:38:03,163::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:38:03,163::task::1185::TaskManager.Task::(prepare) Task=`290d3521-0afe-4ec2-8679-e1bfa005626a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:38:03,164::task::595::TaskManager.Task::(_updateState) Task=`290d3521-0afe-4ec2-8679-e1bfa005626a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:38:03,333::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:38:03,346::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:38:03,357::task::990::TaskManager.Task::(_decref) Task=`290d3521-0afe-4ec2-8679-e1bfa005626a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:38:03,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.221116 s, 4.6 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:38:04,346::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 11:38:04,364::task::595::TaskManager.Task::(_updateState) Task=`52723418-1965-45c4-b3d1-50350fd87eb9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:38:04,390::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:38:04,426::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8ed6f8cd-3eb4-47a2-8bdf-ab73655795a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:38:04,445::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:38:04,553::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:38:04,554::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8ed6f8cd-3eb4-47a2-8bdf-ab73655795a1`::Granted request
>Thread-34::DEBUG::2014-08-21 11:38:04,555::task::827::TaskManager.Task::(resourceAcquired) Task=`52723418-1965-45c4-b3d1-50350fd87eb9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:38:04,556::task::990::TaskManager.Task::(_decref) Task=`52723418-1965-45c4-b3d1-50350fd87eb9`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:38:04,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:38:04,705::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:38:04,706::task::1185::TaskManager.Task::(prepare) Task=`52723418-1965-45c4-b3d1-50350fd87eb9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:38:04,706::task::595::TaskManager.Task::(_updateState) Task=`52723418-1965-45c4-b3d1-50350fd87eb9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:38:04,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:38:04,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:38:04,707::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:38:04,708::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:38:04,708::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:38:04,708::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:38:04,709::task::990::TaskManager.Task::(_decref) Task=`52723418-1965-45c4-b3d1-50350fd87eb9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:38:04,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00124566 s, 400 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:08,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:38:11,001::task::595::TaskManager.Task::(_updateState) Task=`06405e02-5a18-4dbc-b51b-d7a3a24dc3d3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:38:11,002::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:38:11,002::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00124566', 'lastCheck': '6.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:38:11,002::task::1185::TaskManager.Task::(prepare) Task=`06405e02-5a18-4dbc-b51b-d7a3a24dc3d3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00124566', 'lastCheck': '6.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:38:11,003::task::595::TaskManager.Task::(_updateState) Task=`06405e02-5a18-4dbc-b51b-d7a3a24dc3d3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:38:11,003::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:38:11,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:38:11,003::task::990::TaskManager.Task::(_decref) Task=`06405e02-5a18-4dbc-b51b-d7a3a24dc3d3`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:38:15,571::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-13::DEBUG::2014-08-21 11:38:15,575::task::595::TaskManager.Task::(_updateState) Task=`a13fd971-dfa1-4847-b742-d6f67d228ae1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:38:15,578::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:38:15,580::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:38:15,581::task::1185::TaskManager.Task::(prepare) Task=`a13fd971-dfa1-4847-b742-d6f67d228ae1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:38:15,581::task::595::TaskManager.Task::(_updateState) Task=`a13fd971-dfa1-4847-b742-d6f67d228ae1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:38:15,583::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:38:15,604::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:38:15,606::task::990::TaskManager.Task::(_decref) Task=`a13fd971-dfa1-4847-b742-d6f67d228ae1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:38:15,936::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 11:38:15,938::task::595::TaskManager.Task::(_updateState) Task=`fdf5c1f2-12e0-43b0-9149-5805df321703`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:38:15,942::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:38:15,943::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`928f6380-dcd2-46fe-9a32-a40df3d891c0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:38:23,934::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:38:23,942::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:38:23,952::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`928f6380-dcd2-46fe-9a32-a40df3d891c0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:38:23,967::task::827::TaskManager.Task::(resourceAcquired) Task=`fdf5c1f2-12e0-43b0-9149-5805df321703`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:38:23,970::task::990::TaskManager.Task::(_decref) Task=`fdf5c1f2-12e0-43b0-9149-5805df321703`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:38:24,141::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:38:24,148::task::1185::TaskManager.Task::(prepare) Task=`fdf5c1f2-12e0-43b0-9149-5805df321703`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:38:24,153::task::595::TaskManager.Task::(_updateState) Task=`fdf5c1f2-12e0-43b0-9149-5805df321703`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:38:24,159::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:38:24,163::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:38:24,173::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:38:24,180::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:38:24,183::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:38:24,190::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:38:24,205::task::990::TaskManager.Task::(_decref) Task=`fdf5c1f2-12e0-43b0-9149-5805df321703`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:38:24,244::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:38:24,288::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00118801 s, 419 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:24,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 13.4522 s, 76.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:26,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:27,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.410459 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:29,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:29,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0760445 s, 13.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:31,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:31,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0742421 s, 13.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:38:33,197::task::595::TaskManager.Task::(_updateState) Task=`de1bbbc3-520b-4791-894a-451f24a074bf`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:38:33,198::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:38:33,199::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00118801', 'lastCheck': '8.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:38:33,200::task::1185::TaskManager.Task::(prepare) Task=`de1bbbc3-520b-4791-894a-451f24a074bf`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00118801', 'lastCheck': '8.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:38:33,200::task::595::TaskManager.Task::(_updateState) Task=`de1bbbc3-520b-4791-894a-451f24a074bf`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:38:33,200::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:38:33,200::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:38:33,201::task::990::TaskManager.Task::(_decref) Task=`de1bbbc3-520b-4791-894a-451f24a074bf`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:38:36,078::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-26::DEBUG::2014-08-21 11:38:36,086::task::595::TaskManager.Task::(_updateState) Task=`2ec22299-fc32-45f4-9783-39f6ef4f6394`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:38:36,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 11:38:36,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::INFO::2014-08-21 11:38:36,716::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:38:36,901::task::1185::TaskManager.Task::(prepare) Task=`2ec22299-fc32-45f4-9783-39f6ef4f6394`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:38:36,908::task::595::TaskManager.Task::(_updateState) Task=`2ec22299-fc32-45f4-9783-39f6ef4f6394`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:38:36,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:38:36,996::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:38:37,018::task::990::TaskManager.Task::(_decref) Task=`2ec22299-fc32-45f4-9783-39f6ef4f6394`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:38:39,688::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 11:38:39,705::task::595::TaskManager.Task::(_updateState) Task=`360a74c0-4f47-422f-867b-a5cd3bfc541f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:38:39,706::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:38:39,714::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6b6367b0-1681-4f47-9c5e-804657d0c101`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:38:39,715::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:38:39,715::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:38:39,716::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6b6367b0-1681-4f47-9c5e-804657d0c101`::Granted request
>Thread-34::DEBUG::2014-08-21 11:38:39,757::task::827::TaskManager.Task::(resourceAcquired) Task=`360a74c0-4f47-422f-867b-a5cd3bfc541f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:38:39,758::task::990::TaskManager.Task::(_decref) Task=`360a74c0-4f47-422f-867b-a5cd3bfc541f`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:38:39,788::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:38:39,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00762787 s, 65.3 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:38:40,061::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:38:40,365::task::1185::TaskManager.Task::(prepare) Task=`360a74c0-4f47-422f-867b-a5cd3bfc541f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:38:40,367::task::595::TaskManager.Task::(_updateState) Task=`360a74c0-4f47-422f-867b-a5cd3bfc541f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:38:40,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:38:40,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:38:40,369::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:38:40,370::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:38:40,370::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:38:40,371::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:38:40,372::task::990::TaskManager.Task::(_decref) Task=`360a74c0-4f47-422f-867b-a5cd3bfc541f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:38:41,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.37606 s, 431 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:43,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:43,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102759 s, 10.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:45,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:45,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0508753 s, 20.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:47,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:47,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0681785 s, 15.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:49,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:50,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0940041 s, 10.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:38:50,824::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-13::DEBUG::2014-08-21 11:38:50,825::task::595::TaskManager.Task::(_updateState) Task=`f3a73755-0993-436d-b5d7-ee1a18592980`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:38:50,826::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:38:50,828::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:38:50,828::task::1185::TaskManager.Task::(prepare) Task=`f3a73755-0993-436d-b5d7-ee1a18592980`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:38:50,828::task::595::TaskManager.Task::(_updateState) Task=`f3a73755-0993-436d-b5d7-ee1a18592980`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:38:50,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:38:50,829::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:38:50,829::task::990::TaskManager.Task::(_decref) Task=`f3a73755-0993-436d-b5d7-ee1a18592980`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:38:50,835::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 11:38:50,836::task::595::TaskManager.Task::(_updateState) Task=`deb99ccc-095d-41ff-9d24-f3668a564f88`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:38:50,837::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:38:50,838::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`198b6081-c9db-4e52-a568-f4a6d8a66905`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:38:50,838::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:38:50,839::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:38:50,839::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`198b6081-c9db-4e52-a568-f4a6d8a66905`::Granted request
>Thread-34::DEBUG::2014-08-21 11:38:50,840::task::827::TaskManager.Task::(resourceAcquired) Task=`deb99ccc-095d-41ff-9d24-f3668a564f88`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:38:50,840::task::990::TaskManager.Task::(_decref) Task=`deb99ccc-095d-41ff-9d24-f3668a564f88`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:38:50,845::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:38:50,845::task::1185::TaskManager.Task::(prepare) Task=`deb99ccc-095d-41ff-9d24-f3668a564f88`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:38:50,846::task::595::TaskManager.Task::(_updateState) Task=`deb99ccc-095d-41ff-9d24-f3668a564f88`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:38:50,846::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:38:50,846::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:38:50,846::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:38:50,847::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:38:50,847::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:38:50,847::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:38:50,847::task::990::TaskManager.Task::(_decref) Task=`deb99ccc-095d-41ff-9d24-f3668a564f88`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:38:50,916::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:38:50,936::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000397331 s, 1.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:38:51,710::task::595::TaskManager.Task::(_updateState) Task=`769850eb-bdba-414c-93b5-70ab5c3fb020`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:38:51,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:38:51,711::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397331', 'lastCheck': '0.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:38:51,711::task::1185::TaskManager.Task::(prepare) Task=`769850eb-bdba-414c-93b5-70ab5c3fb020`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397331', 'lastCheck': '0.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:38:51,711::task::595::TaskManager.Task::(_updateState) Task=`769850eb-bdba-414c-93b5-70ab5c3fb020`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:38:51,711::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:38:51,712::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:38:51,712::task::990::TaskManager.Task::(_decref) Task=`769850eb-bdba-414c-93b5-70ab5c3fb020`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:38:52,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:52,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111903 s, 9.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:54,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:54,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0797091 s, 12.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:56,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:56,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.337458 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:38:58,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:38:59,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.196012 s, 5.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:39:00,874::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 11:39:00,876::task::595::TaskManager.Task::(_updateState) Task=`3fbb382f-31ce-4730-990f-a3ed74f8b654`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:39:00,876::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:39:00,877::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:39:00,877::task::1185::TaskManager.Task::(prepare) Task=`3fbb382f-31ce-4730-990f-a3ed74f8b654`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:39:00,877::task::595::TaskManager.Task::(_updateState) Task=`3fbb382f-31ce-4730-990f-a3ed74f8b654`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:39:00,878::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:39:00,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:39:00,879::task::990::TaskManager.Task::(_decref) Task=`3fbb382f-31ce-4730-990f-a3ed74f8b654`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:39:00,925::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 11:39:00,926::task::595::TaskManager.Task::(_updateState) Task=`f77c72f7-f913-4ad1-ae5a-7967c99c32ce`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:39:00,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:39:00,927::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d0912439-02b6-42bb-82e9-496892d228e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:39:00,927::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:39:00,928::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:39:00,928::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d0912439-02b6-42bb-82e9-496892d228e6`::Granted request
>Thread-34::DEBUG::2014-08-21 11:39:00,928::task::827::TaskManager.Task::(resourceAcquired) Task=`f77c72f7-f913-4ad1-ae5a-7967c99c32ce`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:39:00,929::task::990::TaskManager.Task::(_decref) Task=`f77c72f7-f913-4ad1-ae5a-7967c99c32ce`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:39:00,934::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:00,934::task::1185::TaskManager.Task::(prepare) Task=`f77c72f7-f913-4ad1-ae5a-7967c99c32ce`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:00,934::task::595::TaskManager.Task::(_updateState) Task=`f77c72f7-f913-4ad1-ae5a-7967c99c32ce`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:39:00,935::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:39:00,935::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:39:00,935::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:39:00,935::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:39:00,936::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:39:00,936::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:39:00,936::task::990::TaskManager.Task::(_decref) Task=`f77c72f7-f913-4ad1-ae5a-7967c99c32ce`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:39:00,954::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:39:00,974::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000691269 s, 720 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:01,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:01,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121708 s, 8.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:07,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:08,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.802337 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:10,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:39:11,700::task::595::TaskManager.Task::(_updateState) Task=`d2dac35a-c966-48ed-ba98-1c819a185a3e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:39:11,701::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:39:11,703::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691269', 'lastCheck': '10.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:39:11,703::task::1185::TaskManager.Task::(prepare) Task=`d2dac35a-c966-48ed-ba98-1c819a185a3e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691269', 'lastCheck': '10.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:39:11,704::task::595::TaskManager.Task::(_updateState) Task=`d2dac35a-c966-48ed-ba98-1c819a185a3e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:39:11,704::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:39:11,704::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:39:11,705::task::990::TaskManager.Task::(_decref) Task=`d2dac35a-c966-48ed-ba98-1c819a185a3e`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:39:11,717::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-26::DEBUG::2014-08-21 11:39:11,718::task::595::TaskManager.Task::(_updateState) Task=`788e6ad9-c03b-4e86-a78a-eaabcfd1d836`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:39:11,718::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:39:11,719::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:39:11,720::task::1185::TaskManager.Task::(prepare) Task=`788e6ad9-c03b-4e86-a78a-eaabcfd1d836`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:39:11,720::task::595::TaskManager.Task::(_updateState) Task=`788e6ad9-c03b-4e86-a78a-eaabcfd1d836`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:39:11,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:39:11,721::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:39:11,721::task::990::TaskManager.Task::(_decref) Task=`788e6ad9-c03b-4e86-a78a-eaabcfd1d836`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:39:12,062::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [146ba42e]
>Thread-15::DEBUG::2014-08-21 11:39:12,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:39:12,071::task::595::TaskManager.Task::(_updateState) Task=`31a25a14-1e10-402e-962c-633a566f60b5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:39:12,092::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:39:12,095::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ce547465-5324-4d8b-8840-db531943418c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:39:12,096::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:39:12,102::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:39:12,106::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ce547465-5324-4d8b-8840-db531943418c`::Granted request
>Thread-34::DEBUG::2014-08-21 11:39:12,154::task::827::TaskManager.Task::(resourceAcquired) Task=`31a25a14-1e10-402e-962c-633a566f60b5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:39:12,156::task::990::TaskManager.Task::(_decref) Task=`31a25a14-1e10-402e-962c-633a566f60b5`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:39:12,177::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00106148 s, 469 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:39:12,198::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:12,202::task::1185::TaskManager.Task::(prepare) Task=`31a25a14-1e10-402e-962c-633a566f60b5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:12,206::task::595::TaskManager.Task::(_updateState) Task=`31a25a14-1e10-402e-962c-633a566f60b5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:39:12,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:39:12,211::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:39:12,215::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:39:12,216::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:39:12,217::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:39:12,218::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:39:12,219::task::990::TaskManager.Task::(_decref) Task=`31a25a14-1e10-402e-962c-633a566f60b5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:39:12,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.283883 s, 3.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:14,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:14,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.126154 s, 8.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:16,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:19,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.06359 s, 496 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:21,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:21,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0674167 s, 15.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:39:22,230::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:39:22,262::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-13::DEBUG::2014-08-21 11:39:22,263::task::595::TaskManager.Task::(_updateState) Task=`62e2ff69-3f91-46bb-9abd-4d17ae276482`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:39:22,264::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:39:22,265::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:39:22,265::task::1185::TaskManager.Task::(prepare) Task=`62e2ff69-3f91-46bb-9abd-4d17ae276482`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:39:22,265::task::595::TaskManager.Task::(_updateState) Task=`62e2ff69-3f91-46bb-9abd-4d17ae276482`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:39:22,266::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:39:22,266::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:39:22,266::task::990::TaskManager.Task::(_decref) Task=`62e2ff69-3f91-46bb-9abd-4d17ae276482`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:39:22,288::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00518762 s, 96.0 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:39:22,317::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-34::DEBUG::2014-08-21 11:39:22,418::task::595::TaskManager.Task::(_updateState) Task=`cedfedcd-2ccb-4fe1-8204-bd7d379abacc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:39:22,443::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:39:22,444::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2b052a8d-05e4-4144-bc1a-1fd4e49e4ae5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:39:22,445::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:39:22,457::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:39:22,457::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2b052a8d-05e4-4144-bc1a-1fd4e49e4ae5`::Granted request
>Thread-34::DEBUG::2014-08-21 11:39:22,458::task::827::TaskManager.Task::(resourceAcquired) Task=`cedfedcd-2ccb-4fe1-8204-bd7d379abacc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:39:22,459::task::990::TaskManager.Task::(_decref) Task=`cedfedcd-2ccb-4fe1-8204-bd7d379abacc`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:39:22,579::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:22,580::task::1185::TaskManager.Task::(prepare) Task=`cedfedcd-2ccb-4fe1-8204-bd7d379abacc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:22,581::task::595::TaskManager.Task::(_updateState) Task=`cedfedcd-2ccb-4fe1-8204-bd7d379abacc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:39:22,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:39:22,582::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:39:22,608::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:39:22,614::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:39:22,615::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:39:22,615::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:39:22,616::task::990::TaskManager.Task::(_decref) Task=`cedfedcd-2ccb-4fe1-8204-bd7d379abacc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:39:23,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:24,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.03718 s, 987 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:26,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:27,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0527599 s, 19.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:39:27,777::task::595::TaskManager.Task::(_updateState) Task=`4e2d41fe-8fc0-4f57-a6d9-50771998928f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:39:27,778::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:39:27,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00518762', 'lastCheck': '5.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:39:27,779::task::1185::TaskManager.Task::(prepare) Task=`4e2d41fe-8fc0-4f57-a6d9-50771998928f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00518762', 'lastCheck': '5.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:39:27,779::task::595::TaskManager.Task::(_updateState) Task=`4e2d41fe-8fc0-4f57-a6d9-50771998928f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:39:27,779::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:39:27,780::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:39:27,780::task::990::TaskManager.Task::(_decref) Task=`4e2d41fe-8fc0-4f57-a6d9-50771998928f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:39:29,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:29,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0890308 s, 11.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:31,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:39:32,722::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-13::DEBUG::2014-08-21 11:39:32,736::task::595::TaskManager.Task::(_updateState) Task=`31c7a992-7f0a-4725-92f8-a6887c185ba5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:39:32,745::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:39:32,760::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:39:32,767::task::1185::TaskManager.Task::(prepare) Task=`31c7a992-7f0a-4725-92f8-a6887c185ba5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:39:32,775::task::595::TaskManager.Task::(_updateState) Task=`31c7a992-7f0a-4725-92f8-a6887c185ba5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:39:32,780::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:39:32,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:39:32,792::task::990::TaskManager.Task::(_decref) Task=`31c7a992-7f0a-4725-92f8-a6887c185ba5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:39:32,815::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3ae1d9eb]
>Thread-34::DEBUG::2014-08-21 11:39:32,819::task::595::TaskManager.Task::(_updateState) Task=`4d6d5984-41bc-4e63-b8df-583daf5992c1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:39:32,822::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:39:32,828::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b87cc66c-c4c5-4ff8-857e-4aff19867c6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:39:32,829::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:39:32,842::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-15::DEBUG::2014-08-21 11:39:32,843::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:39:32,844::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b87cc66c-c4c5-4ff8-857e-4aff19867c6c`::Granted request
>Thread-34::DEBUG::2014-08-21 11:39:38,337::task::827::TaskManager.Task::(resourceAcquired) Task=`4d6d5984-41bc-4e63-b8df-583daf5992c1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:39:38,364::task::990::TaskManager.Task::(_decref) Task=`4d6d5984-41bc-4e63-b8df-583daf5992c1`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:39:38,371::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000595304 s, 837 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:39:38,462::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:38,463::task::1185::TaskManager.Task::(prepare) Task=`4d6d5984-41bc-4e63-b8df-583daf5992c1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:38,465::task::595::TaskManager.Task::(_updateState) Task=`4d6d5984-41bc-4e63-b8df-583daf5992c1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:39:38,466::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:39:38,467::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:39:38,469::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:39:38,471::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:39:38,472::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:39:38,474::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:39:38,476::task::990::TaskManager.Task::(_decref) Task=`4d6d5984-41bc-4e63-b8df-583daf5992c1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:39:38,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.20619 s, 849 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:40,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:40,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.065541 s, 15.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:42,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:42,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.16834 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:45,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:45,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0672029 s, 15.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:47,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:39:47,667::task::595::TaskManager.Task::(_updateState) Task=`7e0793d5-2111-4671-9094-26bac36ea74f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:39:47,978::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:39:47,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595304', 'lastCheck': '9.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:39:47,982::task::1185::TaskManager.Task::(prepare) Task=`7e0793d5-2111-4671-9094-26bac36ea74f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595304', 'lastCheck': '9.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:39:47,983::task::595::TaskManager.Task::(_updateState) Task=`7e0793d5-2111-4671-9094-26bac36ea74f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:39:47,990::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:39:47,991::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:39:47,993::task::990::TaskManager.Task::(_decref) Task=`7e0793d5-2111-4671-9094-26bac36ea74f`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:39:50,604::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-26::DEBUG::2014-08-21 11:39:50,627::task::595::TaskManager.Task::(_updateState) Task=`bec1b494-9038-4aa7-b9c4-cd343e4fa48c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:39:50,628::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:39:50,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:39:50,652::task::1185::TaskManager.Task::(prepare) Task=`bec1b494-9038-4aa7-b9c4-cd343e4fa48c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:39:50,663::task::595::TaskManager.Task::(_updateState) Task=`bec1b494-9038-4aa7-b9c4-cd343e4fa48c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:39:51,101::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:39:51,102::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:39:51,103::task::990::TaskManager.Task::(_decref) Task=`bec1b494-9038-4aa7-b9c4-cd343e4fa48c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:39:51,124::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-34::DEBUG::2014-08-21 11:39:51,127::task::595::TaskManager.Task::(_updateState) Task=`934d04ad-ab35-4ce0-b824-d12b596d7766`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:39:51,128::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:39:51,150::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`57481670-3d58-4a8e-bbfe-ea7421523171`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-15::DEBUG::2014-08-21 11:39:51,357::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:39:51,374::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:39:51,409::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:39:51,409::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`57481670-3d58-4a8e-bbfe-ea7421523171`::Granted request
>Thread-34::DEBUG::2014-08-21 11:39:51,416::task::827::TaskManager.Task::(resourceAcquired) Task=`934d04ad-ab35-4ce0-b824-d12b596d7766`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:39:51,417::task::990::TaskManager.Task::(_decref) Task=`934d04ad-ab35-4ce0-b824-d12b596d7766`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:39:51,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:51,434::task::1185::TaskManager.Task::(prepare) Task=`934d04ad-ab35-4ce0-b824-d12b596d7766`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:39:51,435::task::595::TaskManager.Task::(_updateState) Task=`934d04ad-ab35-4ce0-b824-d12b596d7766`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:39:51,435::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:39:51,436::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:39:51,438::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:39:51,438::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:39:51,439::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:39:51,439::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:39:51,440::task::990::TaskManager.Task::(_decref) Task=`934d04ad-ab35-4ce0-b824-d12b596d7766`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:39:51,455::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0062756 s, 79.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:51,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.20314 s, 244 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:53,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:53,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0940584 s, 10.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:55,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:56,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.123829 s, 8.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:39:58,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:39:58,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894013 s, 11.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:00,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:40:00,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0726382 s, 14.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:40:01,529::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-26::DEBUG::2014-08-21 11:40:01,531::task::595::TaskManager.Task::(_updateState) Task=`3af15f14-7969-4386-b7f1-d1ed3436e6ab`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:40:01,532::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:40:01,532::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:40:01,533::task::1185::TaskManager.Task::(prepare) Task=`3af15f14-7969-4386-b7f1-d1ed3436e6ab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:40:01,533::task::595::TaskManager.Task::(_updateState) Task=`3af15f14-7969-4386-b7f1-d1ed3436e6ab`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:40:01,533::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:40:01,534::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:40:01,534::task::990::TaskManager.Task::(_decref) Task=`3af15f14-7969-4386-b7f1-d1ed3436e6ab`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:40:01,621::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-34::DEBUG::2014-08-21 11:40:01,623::task::595::TaskManager.Task::(_updateState) Task=`4cac6f0f-6347-413c-94ff-799996eaaacd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:40:01,623::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:40:01,624::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bebd9125-977a-490d-ad99-a5435fe6963b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:40:01,625::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:40:01,626::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:40:01,817::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bebd9125-977a-490d-ad99-a5435fe6963b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:40:02,062::task::827::TaskManager.Task::(resourceAcquired) Task=`4cac6f0f-6347-413c-94ff-799996eaaacd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:40:02,065::task::990::TaskManager.Task::(_decref) Task=`4cac6f0f-6347-413c-94ff-799996eaaacd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:40:02,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Dummy-33::DEBUG::2014-08-21 11:40:02,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:40:02,515::task::1185::TaskManager.Task::(prepare) Task=`4cac6f0f-6347-413c-94ff-799996eaaacd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:40:02,520::task::595::TaskManager.Task::(_updateState) Task=`4cac6f0f-6347-413c-94ff-799996eaaacd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:40:02,520::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:40:02,521::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:40:02,536::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:40:02,538::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:40:02,539::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:40:02,540::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:40:02,541::task::990::TaskManager.Task::(_decref) Task=`4cac6f0f-6347-413c-94ff-799996eaaacd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:40:02,546::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:40:02,598::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000947283 s, 526 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:02,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121514 s, 8.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:04,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:40:05,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.382455 s, 2.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:40:06,177::task::595::TaskManager.Task::(_updateState) Task=`9430cf07-fdf1-4c8d-a1b1-36ba21a0b956`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:40:06,177::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:40:06,178::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000947283', 'lastCheck': '3.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:40:06,178::task::1185::TaskManager.Task::(prepare) Task=`9430cf07-fdf1-4c8d-a1b1-36ba21a0b956`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000947283', 'lastCheck': '3.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:40:06,178::task::595::TaskManager.Task::(_updateState) Task=`9430cf07-fdf1-4c8d-a1b1-36ba21a0b956`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:40:06,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:40:06,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:40:06,179::task::990::TaskManager.Task::(_decref) Task=`9430cf07-fdf1-4c8d-a1b1-36ba21a0b956`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:40:08,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:40:09,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.33985 s, 764 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:12,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:40:12,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0762037 s, 13.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:40:12,587::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-26::DEBUG::2014-08-21 11:40:12,588::task::595::TaskManager.Task::(_updateState) Task=`cb73b24d-bc40-436b-b773-f301cca9cd32`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:40:12,588::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:40:12,589::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:40:12,589::task::1185::TaskManager.Task::(prepare) Task=`cb73b24d-bc40-436b-b773-f301cca9cd32`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:40:12,589::task::595::TaskManager.Task::(_updateState) Task=`cb73b24d-bc40-436b-b773-f301cca9cd32`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:40:12,589::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:40:12,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:40:12,590::task::990::TaskManager.Task::(_decref) Task=`cb73b24d-bc40-436b-b773-f301cca9cd32`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:40:12,622::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 11:40:12,625::task::595::TaskManager.Task::(_updateState) Task=`83f194f8-4a27-4c04-acda-b29a19677e63`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:40:12,632::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:40:12,633::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`32c23054-a662-4301-8f26-bb2f8765c85d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:40:12,634::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:40:12,636::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:40:12,637::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`32c23054-a662-4301-8f26-bb2f8765c85d`::Granted request
>Thread-34::DEBUG::2014-08-21 11:40:12,641::task::827::TaskManager.Task::(resourceAcquired) Task=`83f194f8-4a27-4c04-acda-b29a19677e63`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:40:12,642::task::990::TaskManager.Task::(_decref) Task=`83f194f8-4a27-4c04-acda-b29a19677e63`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:40:12,671::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:40:12,672::task::1185::TaskManager.Task::(prepare) Task=`83f194f8-4a27-4c04-acda-b29a19677e63`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:40:12,672::task::595::TaskManager.Task::(_updateState) Task=`83f194f8-4a27-4c04-acda-b29a19677e63`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:40:12,672::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:40:12,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:40:12,673::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:40:12,674::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:40:12,674::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:40:12,674::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:40:12,675::task::990::TaskManager.Task::(_decref) Task=`83f194f8-4a27-4c04-acda-b29a19677e63`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:40:12,734::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:40:12,756::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000527508 s, 944 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:15,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:40:34,731::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-26::DEBUG::2014-08-21 11:40:34,733::task::595::TaskManager.Task::(_updateState) Task=`a852c1fc-42cd-4e5f-8893-0beb22a1d55e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:40:34,733::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:40:34,739::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:40:34,745::task::1185::TaskManager.Task::(prepare) Task=`a852c1fc-42cd-4e5f-8893-0beb22a1d55e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:40:34,763::task::595::TaskManager.Task::(_updateState) Task=`a852c1fc-42cd-4e5f-8893-0beb22a1d55e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:40:34,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:40:34,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:40:34,791::task::990::TaskManager.Task::(_decref) Task=`a852c1fc-42cd-4e5f-8893-0beb22a1d55e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:40:35,303::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-34::DEBUG::2014-08-21 11:40:35,310::task::595::TaskManager.Task::(_updateState) Task=`5fc81063-8fa6-45f2-a8dd-664139106b64`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:40:35,313::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:40:35,319::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7672ad37-7f87-43dd-b3e6-22042e47774b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:40:35,323::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:40:35,327::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:40:35,330::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7672ad37-7f87-43dd-b3e6-22042e47774b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:40:35,337::task::827::TaskManager.Task::(resourceAcquired) Task=`5fc81063-8fa6-45f2-a8dd-664139106b64`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:40:35,339::task::990::TaskManager.Task::(_decref) Task=`5fc81063-8fa6-45f2-a8dd-664139106b64`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:40:35,339::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:40:35,368::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:40:35,370::task::1185::TaskManager.Task::(prepare) Task=`5fc81063-8fa6-45f2-a8dd-664139106b64`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:40:35,372::task::595::TaskManager.Task::(_updateState) Task=`5fc81063-8fa6-45f2-a8dd-664139106b64`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:40:35,374::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:40:35,376::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:40:35,379::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:40:35,383::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:40:35,386::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:40:35,388::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:40:35,392::task::990::TaskManager.Task::(_decref) Task=`5fc81063-8fa6-45f2-a8dd-664139106b64`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:40:35,394::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00413794 s, 120 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:35,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 18.0727 s, 56.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:37,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:40:40,420::task::595::TaskManager.Task::(_updateState) Task=`e8d85243-74cf-4fb2-afe7-f2d9f69cd672`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:40:40,449::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:40:40,452::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00413794', 'lastCheck': '5.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:40:40,453::task::1185::TaskManager.Task::(prepare) Task=`e8d85243-74cf-4fb2-afe7-f2d9f69cd672`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00413794', 'lastCheck': '5.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:40:40,455::task::595::TaskManager.Task::(_updateState) Task=`e8d85243-74cf-4fb2-afe7-f2d9f69cd672`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:40:40,457::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:40:40,458::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:40:40,460::task::990::TaskManager.Task::(_decref) Task=`e8d85243-74cf-4fb2-afe7-f2d9f69cd672`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:40:40,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.456934 s, 2.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:42,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:40:43,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0982863 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:45,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:40:45,499::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-26::DEBUG::2014-08-21 11:40:45,500::task::595::TaskManager.Task::(_updateState) Task=`99145caf-f39b-4463-bf5d-d2254f90cb7a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:40:45,501::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:40:45,502::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:40:45,502::task::1185::TaskManager.Task::(prepare) Task=`99145caf-f39b-4463-bf5d-d2254f90cb7a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:40:45,502::task::595::TaskManager.Task::(_updateState) Task=`99145caf-f39b-4463-bf5d-d2254f90cb7a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:40:45,502::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:40:45,502::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:40:45,503::task::990::TaskManager.Task::(_decref) Task=`99145caf-f39b-4463-bf5d-d2254f90cb7a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:40:48,114::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-34::DEBUG::2014-08-21 11:40:48,118::task::595::TaskManager.Task::(_updateState) Task=`9d8a64f3-c48e-4908-b60d-2a57ae8adacd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:40:48,123::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:40:48,129::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ce0b5534-32ba-48f5-8471-96572a8ebf8f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:40:48,130::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 11:40:48,134::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:40:48,135::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:40:48,149::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ce0b5534-32ba-48f5-8471-96572a8ebf8f`::Granted request
>Thread-34::DEBUG::2014-08-21 11:40:48,152::task::827::TaskManager.Task::(resourceAcquired) Task=`9d8a64f3-c48e-4908-b60d-2a57ae8adacd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:40:48,153::task::990::TaskManager.Task::(_decref) Task=`9d8a64f3-c48e-4908-b60d-2a57ae8adacd`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:40:48,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000775134 s, 642 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:40:48,256::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:40:48,260::task::1185::TaskManager.Task::(prepare) Task=`9d8a64f3-c48e-4908-b60d-2a57ae8adacd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:40:48,264::task::595::TaskManager.Task::(_updateState) Task=`9d8a64f3-c48e-4908-b60d-2a57ae8adacd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:40:48,266::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:40:48,268::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:40:48,270::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:40:48,272::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:40:48,274::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:40:48,274::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:40:48,276::task::990::TaskManager.Task::(_decref) Task=`9d8a64f3-c48e-4908-b60d-2a57ae8adacd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:40:49,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.91497 s, 262 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:51,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:40:51,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0569932 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:53,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:40:54,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.71795 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:56,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:40:56,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.189383 s, 5.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:40:57,167::task::595::TaskManager.Task::(_updateState) Task=`d6e1128e-e1f1-49ae-a40c-1a8b289d0f29`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:40:57,168::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:40:57,168::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775134', 'lastCheck': '8.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:40:57,169::task::1185::TaskManager.Task::(prepare) Task=`d6e1128e-e1f1-49ae-a40c-1a8b289d0f29`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775134', 'lastCheck': '8.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:40:57,169::task::595::TaskManager.Task::(_updateState) Task=`d6e1128e-e1f1-49ae-a40c-1a8b289d0f29`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:40:57,170::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:40:57,170::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:40:57,170::task::990::TaskManager.Task::(_decref) Task=`d6e1128e-e1f1-49ae-a40c-1a8b289d0f29`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:40:58,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:40:58,299::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000464957 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:40:58,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:40:58,938::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-13::DEBUG::2014-08-21 11:40:58,939::task::595::TaskManager.Task::(_updateState) Task=`dbb8bd9a-e525-4898-ae40-14f0e188a074`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:40:58,940::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:40:58,941::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:40:58,942::task::1185::TaskManager.Task::(prepare) Task=`dbb8bd9a-e525-4898-ae40-14f0e188a074`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:40:58,957::task::595::TaskManager.Task::(_updateState) Task=`dbb8bd9a-e525-4898-ae40-14f0e188a074`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:40:58,963::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:40:58,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:40:58,997::task::990::TaskManager.Task::(_decref) Task=`dbb8bd9a-e525-4898-ae40-14f0e188a074`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:40:59,026::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-34::DEBUG::2014-08-21 11:40:59,039::task::595::TaskManager.Task::(_updateState) Task=`1514f85c-3500-40cb-a0d5-2a0fc4ce4a53`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:40:59,041::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:40:59,047::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1cecdd77-0e5b-4c66-ba78-99b2f65f0a5b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:40:59,047::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:40:59,048::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:40:59,049::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1cecdd77-0e5b-4c66-ba78-99b2f65f0a5b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:40:59,087::task::827::TaskManager.Task::(resourceAcquired) Task=`1514f85c-3500-40cb-a0d5-2a0fc4ce4a53`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:40:59,092::task::990::TaskManager.Task::(_decref) Task=`1514f85c-3500-40cb-a0d5-2a0fc4ce4a53`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:40:59,279::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:40:59,280::task::1185::TaskManager.Task::(prepare) Task=`1514f85c-3500-40cb-a0d5-2a0fc4ce4a53`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:40:59,286::task::595::TaskManager.Task::(_updateState) Task=`1514f85c-3500-40cb-a0d5-2a0fc4ce4a53`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:40:59,287::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:40:59,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:40:59,290::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:40:59,292::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:40:59,294::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:40:59,294::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:40:59,296::task::990::TaskManager.Task::(_decref) Task=`1514f85c-3500-40cb-a0d5-2a0fc4ce4a53`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:40:59,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100791 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:01,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:41:14,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-26::DEBUG::2014-08-21 11:41:19,770::task::595::TaskManager.Task::(_updateState) Task=`9f5dba3e-0f11-45fb-be91-03208bad62ea`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:41:19,779::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:41:19,789::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:41:19,790::task::1185::TaskManager.Task::(prepare) Task=`9f5dba3e-0f11-45fb-be91-03208bad62ea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:41:19,790::task::595::TaskManager.Task::(_updateState) Task=`9f5dba3e-0f11-45fb-be91-03208bad62ea`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:41:19,791::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:41:19,791::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:41:19,791::task::990::TaskManager.Task::(_decref) Task=`9f5dba3e-0f11-45fb-be91-03208bad62ea`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:41:20,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.968 s, 93.4 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:41:20,507::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:41:20,565::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 11:41:20,567::task::595::TaskManager.Task::(_updateState) Task=`d4fa7703-d691-4a23-8ed5-5904ed3c7e8d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:41:20,567::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:41:20,568::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`962355e7-d418-4994-a8b3-d576be71d260`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:41:20,569::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:41:20,570::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:41:20,570::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`962355e7-d418-4994-a8b3-d576be71d260`::Granted request
>Thread-34::DEBUG::2014-08-21 11:41:20,571::task::827::TaskManager.Task::(resourceAcquired) Task=`d4fa7703-d691-4a23-8ed5-5904ed3c7e8d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:41:20,572::task::990::TaskManager.Task::(_decref) Task=`d4fa7703-d691-4a23-8ed5-5904ed3c7e8d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:41:20,579::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:41:20,579::task::1185::TaskManager.Task::(prepare) Task=`d4fa7703-d691-4a23-8ed5-5904ed3c7e8d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:41:20,580::task::595::TaskManager.Task::(_updateState) Task=`d4fa7703-d691-4a23-8ed5-5904ed3c7e8d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:41:20,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:41:20,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:41:20,581::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:41:20,581::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:41:20,582::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:41:20,582::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:41:20,583::task::990::TaskManager.Task::(_decref) Task=`d4fa7703-d691-4a23-8ed5-5904ed3c7e8d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:41:20,640::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000744536 s, 669 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:22,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:41:25,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.79776 s, 366 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:27,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:41:27,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0712058 s, 14.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:29,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:41:29,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.156699 s, 6.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:41:30,657::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-26::DEBUG::2014-08-21 11:41:30,664::task::595::TaskManager.Task::(_updateState) Task=`e915227f-9a1d-42e0-8757-a20657341a66`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:41:30,664::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:41:30,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:41:30,665::task::1185::TaskManager.Task::(prepare) Task=`e915227f-9a1d-42e0-8757-a20657341a66`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:41:30,666::task::595::TaskManager.Task::(_updateState) Task=`e915227f-9a1d-42e0-8757-a20657341a66`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:41:30,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:41:30,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:41:30,667::task::990::TaskManager.Task::(_decref) Task=`e915227f-9a1d-42e0-8757-a20657341a66`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:41:30,702::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-34::DEBUG::2014-08-21 11:41:30,703::task::595::TaskManager.Task::(_updateState) Task=`f2c9ae4c-482d-44e2-8f35-89ba51751566`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:41:30,703::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:41:30,707::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cd1a6233-c147-492f-a9da-3d51376621c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:41:30,710::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:41:30,715::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:41:30,718::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cd1a6233-c147-492f-a9da-3d51376621c3`::Granted request
>Thread-34::DEBUG::2014-08-21 11:41:30,723::task::827::TaskManager.Task::(resourceAcquired) Task=`f2c9ae4c-482d-44e2-8f35-89ba51751566`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:41:30,726::task::990::TaskManager.Task::(_decref) Task=`f2c9ae4c-482d-44e2-8f35-89ba51751566`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:41:30,750::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895080960', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:41:30,750::task::1185::TaskManager.Task::(prepare) Task=`f2c9ae4c-482d-44e2-8f35-89ba51751566`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895080960', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:41:30,752::task::595::TaskManager.Task::(_updateState) Task=`f2c9ae4c-482d-44e2-8f35-89ba51751566`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:41:30,753::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:41:30,754::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:41:30,757::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:41:30,760::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:41:30,762::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:41:30,764::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:41:30,767::task::990::TaskManager.Task::(_decref) Task=`f2c9ae4c-482d-44e2-8f35-89ba51751566`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:41:30,783::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:41:30,800::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000530791 s, 938 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:41:30,934::task::595::TaskManager.Task::(_updateState) Task=`54c0cbb1-d9ab-4700-ae0b-acf4653b962c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:41:30,935::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:41:30,935::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530791', 'lastCheck': '0.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:41:30,935::task::1185::TaskManager.Task::(prepare) Task=`54c0cbb1-d9ab-4700-ae0b-acf4653b962c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530791', 'lastCheck': '0.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:41:30,936::task::595::TaskManager.Task::(_updateState) Task=`54c0cbb1-d9ab-4700-ae0b-acf4653b962c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:41:30,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:41:30,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:41:30,937::task::990::TaskManager.Task::(_decref) Task=`54c0cbb1-d9ab-4700-ae0b-acf4653b962c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:41:31,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:41:31,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119604 s, 8.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:33,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:41:34,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436542 s, 23.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:36,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:41:37,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.408792 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:39,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:41:40,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.952174 s, 1.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:41:40,794::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-26::DEBUG::2014-08-21 11:41:40,795::task::595::TaskManager.Task::(_updateState) Task=`6fb57a98-a3bf-487d-8947-9ea20b1bfbe7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:41:40,795::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:41:40,796::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:41:40,796::task::1185::TaskManager.Task::(prepare) Task=`6fb57a98-a3bf-487d-8947-9ea20b1bfbe7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:41:40,797::task::595::TaskManager.Task::(_updateState) Task=`6fb57a98-a3bf-487d-8947-9ea20b1bfbe7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:41:40,797::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:41:40,797::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:41:40,798::task::990::TaskManager.Task::(_decref) Task=`6fb57a98-a3bf-487d-8947-9ea20b1bfbe7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:41:40,802::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-34::DEBUG::2014-08-21 11:41:40,803::task::595::TaskManager.Task::(_updateState) Task=`40785a84-ebba-47a4-8aa7-d292dd357e0b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:41:40,803::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:41:40,804::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2ae9c1b4-cadd-4a4c-a3a1-d1da3cad33b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:41:40,804::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:41:40,804::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:41:40,805::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2ae9c1b4-cadd-4a4c-a3a1-d1da3cad33b2`::Granted request
>Thread-34::DEBUG::2014-08-21 11:41:40,805::task::827::TaskManager.Task::(resourceAcquired) Task=`40785a84-ebba-47a4-8aa7-d292dd357e0b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:41:40,805::task::990::TaskManager.Task::(_decref) Task=`40785a84-ebba-47a4-8aa7-d292dd357e0b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:41:40,860::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:41:40,861::task::1185::TaskManager.Task::(prepare) Task=`40785a84-ebba-47a4-8aa7-d292dd357e0b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:41:40,861::task::595::TaskManager.Task::(_updateState) Task=`40785a84-ebba-47a4-8aa7-d292dd357e0b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:41:40,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:41:40,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:41:40,863::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:41:40,864::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:41:40,865::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:41:40,865::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:41:40,866::task::990::TaskManager.Task::(_decref) Task=`40785a84-ebba-47a4-8aa7-d292dd357e0b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:41:40,903::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:41:40,924::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00107695 s, 462 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:42,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:41:47,615::task::595::TaskManager.Task::(_updateState) Task=`4b4d1aad-c1f4-4170-9473-44bd46b685d6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:41:47,619::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:41:47,642::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107695', 'lastCheck': '6.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:41:47,645::task::1185::TaskManager.Task::(prepare) Task=`4b4d1aad-c1f4-4170-9473-44bd46b685d6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107695', 'lastCheck': '6.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:41:47,647::task::595::TaskManager.Task::(_updateState) Task=`4b4d1aad-c1f4-4170-9473-44bd46b685d6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:41:47,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:41:47,651::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:41:47,652::task::990::TaskManager.Task::(_decref) Task=`4b4d1aad-c1f4-4170-9473-44bd46b685d6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:41:51,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.74185 s, 216 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:41:51,540::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-26::DEBUG::2014-08-21 11:41:51,546::task::595::TaskManager.Task::(_updateState) Task=`4e978ff9-e953-40e4-96a9-a122c565178e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:41:51,549::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:41:51,553::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:41:51,554::task::1185::TaskManager.Task::(prepare) Task=`4e978ff9-e953-40e4-96a9-a122c565178e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:41:51,555::task::595::TaskManager.Task::(_updateState) Task=`4e978ff9-e953-40e4-96a9-a122c565178e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:41:51,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:41:51,556::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:41:51,557::task::990::TaskManager.Task::(_decref) Task=`4e978ff9-e953-40e4-96a9-a122c565178e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:41:51,621::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-34::DEBUG::2014-08-21 11:41:51,623::task::595::TaskManager.Task::(_updateState) Task=`fd1eeb04-bff5-4672-9bba-790f0bd6fc12`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:41:51,623::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:41:51,625::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1852a9a-afb9-4b7e-85ed-a7072d9cd362`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:41:51,625::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:41:51,626::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:41:51,627::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f1852a9a-afb9-4b7e-85ed-a7072d9cd362`::Granted request
>Thread-34::DEBUG::2014-08-21 11:41:51,628::task::827::TaskManager.Task::(resourceAcquired) Task=`fd1eeb04-bff5-4672-9bba-790f0bd6fc12`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:41:51,629::task::990::TaskManager.Task::(_decref) Task=`fd1eeb04-bff5-4672-9bba-790f0bd6fc12`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:41:51,745::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:41:52,078::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:41:52,266::task::1185::TaskManager.Task::(prepare) Task=`fd1eeb04-bff5-4672-9bba-790f0bd6fc12`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:41:52,347::task::595::TaskManager.Task::(_updateState) Task=`fd1eeb04-bff5-4672-9bba-790f0bd6fc12`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:41:52,348::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:41:52,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 11:41:53,004::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0688197 s, 7.2 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:41:53,007::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Dummy-33::DEBUG::2014-08-21 11:41:53,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:41:53,657::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:41:53,658::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:41:53,660::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:41:53,880::task::990::TaskManager.Task::(_decref) Task=`fd1eeb04-bff5-4672-9bba-790f0bd6fc12`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:41:54,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.429086 s, 2.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:56,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:41:56,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.127241 s, 8.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:41:58,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:41:58,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100393 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:00,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:00,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459317 s, 22.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:02,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:03,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.210789 s, 4.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:42:03,889::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:42:03,903::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000627908 s, 793 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:42:03,968::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-26::DEBUG::2014-08-21 11:42:03,969::task::595::TaskManager.Task::(_updateState) Task=`ef34c943-4d85-41bc-bb7e-f2e3aea75543`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:03,969::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:42:03,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:03,970::task::1185::TaskManager.Task::(prepare) Task=`ef34c943-4d85-41bc-bb7e-f2e3aea75543`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:03,970::task::595::TaskManager.Task::(_updateState) Task=`ef34c943-4d85-41bc-bb7e-f2e3aea75543`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:03,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:03,970::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:03,970::task::990::TaskManager.Task::(_decref) Task=`ef34c943-4d85-41bc-bb7e-f2e3aea75543`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:42:03,978::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-34::DEBUG::2014-08-21 11:42:03,980::task::595::TaskManager.Task::(_updateState) Task=`0cd10d39-292f-4947-9b11-79479ec97c65`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:42:03,982::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:42:03,986::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f34ae1c9-d8ea-4bde-8bce-ba58700a34e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:42:03,988::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:42:03,990::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:42:03,991::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f34ae1c9-d8ea-4bde-8bce-ba58700a34e2`::Granted request
>Thread-34::DEBUG::2014-08-21 11:42:03,995::task::827::TaskManager.Task::(resourceAcquired) Task=`0cd10d39-292f-4947-9b11-79479ec97c65`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:42:03,996::task::990::TaskManager.Task::(_decref) Task=`0cd10d39-292f-4947-9b11-79479ec97c65`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:42:04,003::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:04,003::task::1185::TaskManager.Task::(prepare) Task=`0cd10d39-292f-4947-9b11-79479ec97c65`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:04,003::task::595::TaskManager.Task::(_updateState) Task=`0cd10d39-292f-4947-9b11-79479ec97c65`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:42:04,003::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:42:04,004::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:42:04,004::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:42:04,004::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:42:04,004::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:42:04,005::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:42:04,005::task::990::TaskManager.Task::(_decref) Task=`0cd10d39-292f-4947-9b11-79479ec97c65`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:42:05,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:05,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564255 s, 18.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:42:05,951::task::595::TaskManager.Task::(_updateState) Task=`c2bc43f2-a377-4f40-b147-de82674f9ea5`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:05,952::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:42:05,953::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627908', 'lastCheck': '2.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:42:05,953::task::1185::TaskManager.Task::(prepare) Task=`c2bc43f2-a377-4f40-b147-de82674f9ea5`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627908', 'lastCheck': '2.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:42:05,953::task::595::TaskManager.Task::(_updateState) Task=`c2bc43f2-a377-4f40-b147-de82674f9ea5`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:05,954::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:05,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:05,954::task::990::TaskManager.Task::(_decref) Task=`c2bc43f2-a377-4f40-b147-de82674f9ea5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:42:07,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:07,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0961552 s, 10.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:09,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:09,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554841 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:11,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:12,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.312059 s, 3.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:42:14,001::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:42:14,049::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-26::DEBUG::2014-08-21 11:42:14,050::task::595::TaskManager.Task::(_updateState) Task=`689cf294-d441-422f-9767-f53da9996b75`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:14,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:42:14,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:14,052::task::1185::TaskManager.Task::(prepare) Task=`689cf294-d441-422f-9767-f53da9996b75`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:14,052::task::595::TaskManager.Task::(_updateState) Task=`689cf294-d441-422f-9767-f53da9996b75`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:14,052::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:14,053::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:14,053::task::990::TaskManager.Task::(_decref) Task=`689cf294-d441-422f-9767-f53da9996b75`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:42:14,061::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0151102 s, 33.0 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:42:14,099::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 11:42:14,103::task::595::TaskManager.Task::(_updateState) Task=`b68a1a67-234a-49ca-a079-82f21d7d9efe`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:42:14,105::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:42:14,106::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`27c4c4ed-96fa-4174-bfb6-475ae20bd187`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:42:14,106::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:42:14,107::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:42:14,107::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`27c4c4ed-96fa-4174-bfb6-475ae20bd187`::Granted request
>Thread-34::DEBUG::2014-08-21 11:42:14,108::task::827::TaskManager.Task::(resourceAcquired) Task=`b68a1a67-234a-49ca-a079-82f21d7d9efe`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:42:14,108::task::990::TaskManager.Task::(_decref) Task=`b68a1a67-234a-49ca-a079-82f21d7d9efe`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:42:14,114::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:14,114::task::1185::TaskManager.Task::(prepare) Task=`b68a1a67-234a-49ca-a079-82f21d7d9efe`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:14,114::task::595::TaskManager.Task::(_updateState) Task=`b68a1a67-234a-49ca-a079-82f21d7d9efe`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:42:14,115::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:42:14,115::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:42:14,115::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:42:14,116::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:42:14,116::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:42:14,116::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:42:14,116::task::990::TaskManager.Task::(_decref) Task=`b68a1a67-234a-49ca-a079-82f21d7d9efe`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:42:14,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:15,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.640617 s, 1.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:17,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:17,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.143409 s, 7.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:19,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:19,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.232076 s, 4.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:42:21,207::task::595::TaskManager.Task::(_updateState) Task=`4285c1a1-d192-44e4-a0c9-c7297a7a212c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:21,207::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:42:21,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0151102', 'lastCheck': '7.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:42:21,208::task::1185::TaskManager.Task::(prepare) Task=`4285c1a1-d192-44e4-a0c9-c7297a7a212c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0151102', 'lastCheck': '7.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:42:21,208::task::595::TaskManager.Task::(_updateState) Task=`4285c1a1-d192-44e4-a0c9-c7297a7a212c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:21,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:21,209::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:21,209::task::990::TaskManager.Task::(_decref) Task=`4285c1a1-d192-44e4-a0c9-c7297a7a212c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:42:21,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:22,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0925168 s, 11.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:24,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:42:24,137::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:42:24,155::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-26::DEBUG::2014-08-21 11:42:24,156::task::595::TaskManager.Task::(_updateState) Task=`52eb8633-13c1-4e79-8b13-9c07913c6735`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:24,156::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:42:24,157::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:24,157::task::1185::TaskManager.Task::(prepare) Task=`52eb8633-13c1-4e79-8b13-9c07913c6735`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:24,157::task::595::TaskManager.Task::(_updateState) Task=`52eb8633-13c1-4e79-8b13-9c07913c6735`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:24,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:24,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:24,158::task::990::TaskManager.Task::(_decref) Task=`52eb8633-13c1-4e79-8b13-9c07913c6735`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:42:24,163::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-34::DEBUG::2014-08-21 11:42:24,164::task::595::TaskManager.Task::(_updateState) Task=`d91d4fef-1b2f-46ee-bdb2-52ca99a03bcd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:42:24,164::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:42:24,166::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`44680ecd-d9c9-4677-9114-25a8cd3fd796`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:42:24,166::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:42:24,167::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:42:24,168::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`44680ecd-d9c9-4677-9114-25a8cd3fd796`::Granted request
>Thread-34::DEBUG::2014-08-21 11:42:24,168::task::827::TaskManager.Task::(resourceAcquired) Task=`d91d4fef-1b2f-46ee-bdb2-52ca99a03bcd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:42:24,169::task::990::TaskManager.Task::(_decref) Task=`d91d4fef-1b2f-46ee-bdb2-52ca99a03bcd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:42:24,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:24,177::task::1185::TaskManager.Task::(prepare) Task=`d91d4fef-1b2f-46ee-bdb2-52ca99a03bcd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:24,177::task::595::TaskManager.Task::(_updateState) Task=`d91d4fef-1b2f-46ee-bdb2-52ca99a03bcd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:42:24,177::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:42:24,178::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:42:24,179::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:42:24,179::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:42:24,179::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:42:24,179::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:42:24,180::task::990::TaskManager.Task::(_decref) Task=`d91d4fef-1b2f-46ee-bdb2-52ca99a03bcd`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:42:24,253::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00795963 s, 62.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:24,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.304861 s, 3.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:26,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:26,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0569641 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:28,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:30,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.40227 s, 730 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:32,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:32,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.141595 s, 7.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:42:34,204::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-26::DEBUG::2014-08-21 11:42:34,205::task::595::TaskManager.Task::(_updateState) Task=`bf07f176-3903-4194-b837-bba2603adea9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:34,205::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:42:34,206::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:34,206::task::1185::TaskManager.Task::(prepare) Task=`bf07f176-3903-4194-b837-bba2603adea9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:34,206::task::595::TaskManager.Task::(_updateState) Task=`bf07f176-3903-4194-b837-bba2603adea9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:34,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:34,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:34,206::task::990::TaskManager.Task::(_decref) Task=`bf07f176-3903-4194-b837-bba2603adea9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:42:34,211::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-34::DEBUG::2014-08-21 11:42:34,211::task::595::TaskManager.Task::(_updateState) Task=`88ccb916-e2c3-406e-9a98-f88af63bf1b3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:42:34,212::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:42:34,212::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`de120360-ac0b-4ce2-813c-59516123e6cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:42:34,213::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:42:34,213::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:42:34,213::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`de120360-ac0b-4ce2-813c-59516123e6cf`::Granted request
>Thread-34::DEBUG::2014-08-21 11:42:34,214::task::827::TaskManager.Task::(resourceAcquired) Task=`88ccb916-e2c3-406e-9a98-f88af63bf1b3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:42:34,214::task::990::TaskManager.Task::(_decref) Task=`88ccb916-e2c3-406e-9a98-f88af63bf1b3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:42:34,219::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:34,219::task::1185::TaskManager.Task::(prepare) Task=`88ccb916-e2c3-406e-9a98-f88af63bf1b3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:34,220::task::595::TaskManager.Task::(_updateState) Task=`88ccb916-e2c3-406e-9a98-f88af63bf1b3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:42:34,220::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:42:34,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:42:34,221::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:42:34,221::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:42:34,221::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:42:34,222::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:42:34,222::task::990::TaskManager.Task::(_decref) Task=`88ccb916-e2c3-406e-9a98-f88af63bf1b3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:42:34,372::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:42:34,392::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:42:34,418::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Dummy-33::DEBUG::2014-08-21 11:42:34,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:42:34,474::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 11:42:34,547::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:42:34,547::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:42:34,548::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 11:42:34,623::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:42:34,984::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0150329 s, 33.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:35,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.13488 s, 902 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:42:36,417::task::595::TaskManager.Task::(_updateState) Task=`04a4914e-6565-4360-971a-120fbd8ed5a6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:36,418::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:42:36,418::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0150329', 'lastCheck': '0.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:42:36,419::task::1185::TaskManager.Task::(prepare) Task=`04a4914e-6565-4360-971a-120fbd8ed5a6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0150329', 'lastCheck': '0.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:42:36,419::task::595::TaskManager.Task::(_updateState) Task=`04a4914e-6565-4360-971a-120fbd8ed5a6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:36,419::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:36,420::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:36,420::task::990::TaskManager.Task::(_decref) Task=`04a4914e-6565-4360-971a-120fbd8ed5a6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:42:37,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:37,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501372 s, 20.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:39,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:40,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0690365 s, 14.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:42,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:43,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.213621 s, 4.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:42:44,241::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-26::DEBUG::2014-08-21 11:42:44,242::task::595::TaskManager.Task::(_updateState) Task=`c082cb3a-c7d5-4b6b-ab19-97b7ec17a93b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:44,243::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:42:44,243::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:44,244::task::1185::TaskManager.Task::(prepare) Task=`c082cb3a-c7d5-4b6b-ab19-97b7ec17a93b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:44,244::task::595::TaskManager.Task::(_updateState) Task=`c082cb3a-c7d5-4b6b-ab19-97b7ec17a93b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:44,244::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:44,245::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:44,245::task::990::TaskManager.Task::(_decref) Task=`c082cb3a-c7d5-4b6b-ab19-97b7ec17a93b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:42:44,255::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-34::DEBUG::2014-08-21 11:42:44,256::task::595::TaskManager.Task::(_updateState) Task=`1d59a08b-aac0-48d6-8eb8-7aac5ccae64e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:42:44,256::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:42:44,257::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ab40ebfa-3643-4464-b49b-3aadabe0372a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:42:44,258::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:42:44,258::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:42:44,259::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ab40ebfa-3643-4464-b49b-3aadabe0372a`::Granted request
>Thread-34::DEBUG::2014-08-21 11:42:44,259::task::827::TaskManager.Task::(resourceAcquired) Task=`1d59a08b-aac0-48d6-8eb8-7aac5ccae64e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:42:44,260::task::990::TaskManager.Task::(_decref) Task=`1d59a08b-aac0-48d6-8eb8-7aac5ccae64e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:42:44,270::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:44,271::task::1185::TaskManager.Task::(prepare) Task=`1d59a08b-aac0-48d6-8eb8-7aac5ccae64e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:44,271::task::595::TaskManager.Task::(_updateState) Task=`1d59a08b-aac0-48d6-8eb8-7aac5ccae64e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:42:44,272::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:42:44,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:42:44,272::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:42:44,273::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:42:44,273::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:42:44,274::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:42:44,275::task::990::TaskManager.Task::(_decref) Task=`1d59a08b-aac0-48d6-8eb8-7aac5ccae64e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:42:45,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:42:45,697::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:42:45,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000793736 s, 627 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:45,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0765248 s, 13.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:47,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:48,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.123842 s, 8.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:50,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:50,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121918 s, 8.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:42:51,893::task::595::TaskManager.Task::(_updateState) Task=`2e81e317-98e6-4de3-817f-7d2165cd399a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:51,893::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:42:51,894::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000793736', 'lastCheck': '6.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:42:51,894::task::1185::TaskManager.Task::(prepare) Task=`2e81e317-98e6-4de3-817f-7d2165cd399a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000793736', 'lastCheck': '6.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:42:51,894::task::595::TaskManager.Task::(_updateState) Task=`2e81e317-98e6-4de3-817f-7d2165cd399a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:51,894::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:51,895::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:51,895::task::990::TaskManager.Task::(_decref) Task=`2e81e317-98e6-4de3-817f-7d2165cd399a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:42:52,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:52,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0732861 s, 14.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:42:54,289::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-26::DEBUG::2014-08-21 11:42:54,292::task::595::TaskManager.Task::(_updateState) Task=`34e91e15-49ae-4e11-8cb6-7d604c99efa0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:42:54,292::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:42:54,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:54,293::task::1185::TaskManager.Task::(prepare) Task=`34e91e15-49ae-4e11-8cb6-7d604c99efa0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:42:54,294::task::595::TaskManager.Task::(_updateState) Task=`34e91e15-49ae-4e11-8cb6-7d604c99efa0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:42:54,294::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:42:54,294::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:42:54,294::task::990::TaskManager.Task::(_decref) Task=`34e91e15-49ae-4e11-8cb6-7d604c99efa0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:42:54,301::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-34::DEBUG::2014-08-21 11:42:54,302::task::595::TaskManager.Task::(_updateState) Task=`d2268503-c562-4672-b63c-76f08bd83fbd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:42:54,302::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:42:54,303::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2db9c951-2ff8-4b8b-af95-40b6e7e0e255`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:42:54,303::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:42:54,304::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:42:54,304::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2db9c951-2ff8-4b8b-af95-40b6e7e0e255`::Granted request
>Thread-34::DEBUG::2014-08-21 11:42:54,304::task::827::TaskManager.Task::(resourceAcquired) Task=`d2268503-c562-4672-b63c-76f08bd83fbd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:42:54,305::task::990::TaskManager.Task::(_decref) Task=`d2268503-c562-4672-b63c-76f08bd83fbd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:42:54,309::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:54,310::task::1185::TaskManager.Task::(prepare) Task=`d2268503-c562-4672-b63c-76f08bd83fbd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:42:54,310::task::595::TaskManager.Task::(_updateState) Task=`d2268503-c562-4672-b63c-76f08bd83fbd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:42:54,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:42:54,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:42:54,311::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:42:54,311::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:42:54,312::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:42:54,312::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:42:54,312::task::990::TaskManager.Task::(_decref) Task=`d2268503-c562-4672-b63c-76f08bd83fbd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:42:54,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:54,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473217 s, 21.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:42:55,771::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:42:55,793::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00120876 s, 412 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:56,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:57,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.342592 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:42:59,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:42:59,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0852367 s, 12.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:01,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:01,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479494 s, 21.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:03,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:43:04,494::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-13::DEBUG::2014-08-21 11:43:05,585::task::595::TaskManager.Task::(_updateState) Task=`07015966-6cbd-4fbf-bf29-66a4564050ae`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:43:05,592::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:43:05,599::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:43:05,602::task::1185::TaskManager.Task::(prepare) Task=`07015966-6cbd-4fbf-bf29-66a4564050ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:43:05,605::task::595::TaskManager.Task::(_updateState) Task=`07015966-6cbd-4fbf-bf29-66a4564050ae`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:43:05,623::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:43:05,623::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:43:05,623::task::990::TaskManager.Task::(_decref) Task=`07015966-6cbd-4fbf-bf29-66a4564050ae`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:43:05,667::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-34::DEBUG::2014-08-21 11:43:05,669::task::595::TaskManager.Task::(_updateState) Task=`404d3b1f-e800-46c4-b84b-9511c3746824`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:43:05,670::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:43:05,671::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0ae167da-3a00-4718-babe-88c3b2625ac0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:43:05,672::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:43:05,673::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:43:05,673::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0ae167da-3a00-4718-babe-88c3b2625ac0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:43:05,673::task::827::TaskManager.Task::(resourceAcquired) Task=`404d3b1f-e800-46c4-b84b-9511c3746824`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:43:05,674::task::990::TaskManager.Task::(_decref) Task=`404d3b1f-e800-46c4-b84b-9511c3746824`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:43:05,680::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:05,680::task::1185::TaskManager.Task::(prepare) Task=`404d3b1f-e800-46c4-b84b-9511c3746824`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:05,681::task::595::TaskManager.Task::(_updateState) Task=`404d3b1f-e800-46c4-b84b-9511c3746824`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:43:05,681::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:43:05,681::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:43:05,682::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:43:05,682::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:43:05,682::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:43:05,682::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:43:05,684::task::990::TaskManager.Task::(_decref) Task=`404d3b1f-e800-46c4-b84b-9511c3746824`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:43:05,822::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:43:05,866::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000659983 s, 755 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:06,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.81188 s, 565 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:08,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:08,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137664 s, 7.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:43:08,447::task::595::TaskManager.Task::(_updateState) Task=`1e9e0196-bf9e-408f-b906-8c8ca0882e7d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:43:08,448::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:43:08,448::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659983', 'lastCheck': '2.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:43:08,449::task::1185::TaskManager.Task::(prepare) Task=`1e9e0196-bf9e-408f-b906-8c8ca0882e7d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659983', 'lastCheck': '2.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:43:08,449::task::595::TaskManager.Task::(_updateState) Task=`1e9e0196-bf9e-408f-b906-8c8ca0882e7d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:43:08,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:43:08,450::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:43:08,450::task::990::TaskManager.Task::(_decref) Task=`1e9e0196-bf9e-408f-b906-8c8ca0882e7d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:43:10,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:11,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0550587 s, 18.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:13,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:13,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101066 s, 10.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:15,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:43:15,789::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-13::DEBUG::2014-08-21 11:43:15,824::task::595::TaskManager.Task::(_updateState) Task=`f6dd3cf8-84dc-4e7b-baae-1ec4b4a39c7c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:43:15,824::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:43:15,825::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:43:15,825::task::1185::TaskManager.Task::(prepare) Task=`f6dd3cf8-84dc-4e7b-baae-1ec4b4a39c7c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:43:15,825::task::595::TaskManager.Task::(_updateState) Task=`f6dd3cf8-84dc-4e7b-baae-1ec4b4a39c7c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:43:15,825::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:43:15,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:43:15,826::task::990::TaskManager.Task::(_decref) Task=`f6dd3cf8-84dc-4e7b-baae-1ec4b4a39c7c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:43:15,949::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-34::DEBUG::2014-08-21 11:43:16,125::task::595::TaskManager.Task::(_updateState) Task=`88b44429-bc89-4d42-b2be-edc50fbde666`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:43:17,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:43:17,431::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a00a7e9c-d0e9-4e3f-9f81-6b1f505de764`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:43:17,431::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:43:17,432::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:43:17,432::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a00a7e9c-d0e9-4e3f-9f81-6b1f505de764`::Granted request
>Thread-34::DEBUG::2014-08-21 11:43:17,435::task::827::TaskManager.Task::(resourceAcquired) Task=`88b44429-bc89-4d42-b2be-edc50fbde666`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:43:17,435::task::990::TaskManager.Task::(_decref) Task=`88b44429-bc89-4d42-b2be-edc50fbde666`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:43:17,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:17,515::task::1185::TaskManager.Task::(prepare) Task=`88b44429-bc89-4d42-b2be-edc50fbde666`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:17,517::task::595::TaskManager.Task::(_updateState) Task=`88b44429-bc89-4d42-b2be-edc50fbde666`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:43:17,518::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:43:17,519::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:43:17,520::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:43:17,521::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:43:17,521::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:43:17,521::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:43:17,522::task::990::TaskManager.Task::(_decref) Task=`88b44429-bc89-4d42-b2be-edc50fbde666`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:43:17,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:43:18,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0582247 s, 8.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:18,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.35642 s, 435 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:20,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:20,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.185858 s, 5.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:22,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:23,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.191949 s, 5.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:43:23,931::task::595::TaskManager.Task::(_updateState) Task=`0b1b8c07-79c9-42fc-8b14-4252397d4481`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:43:23,931::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:43:23,931::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0582247', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:43:23,932::task::1185::TaskManager.Task::(prepare) Task=`0b1b8c07-79c9-42fc-8b14-4252397d4481`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0582247', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:43:23,932::task::595::TaskManager.Task::(_updateState) Task=`0b1b8c07-79c9-42fc-8b14-4252397d4481`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:43:23,932::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:43:23,932::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:43:23,932::task::990::TaskManager.Task::(_decref) Task=`0b1b8c07-79c9-42fc-8b14-4252397d4481`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:43:25,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:25,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0572813 s, 17.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:27,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:43:27,611::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 11:43:27,614::task::595::TaskManager.Task::(_updateState) Task=`675732bb-8e6f-438c-b429-6219ca8a5a14`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:43:27,615::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:43:27,616::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:43:27,616::task::1185::TaskManager.Task::(prepare) Task=`675732bb-8e6f-438c-b429-6219ca8a5a14`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:43:27,617::task::595::TaskManager.Task::(_updateState) Task=`675732bb-8e6f-438c-b429-6219ca8a5a14`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:43:27,617::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:43:27,617::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:43:27,618::task::990::TaskManager.Task::(_decref) Task=`675732bb-8e6f-438c-b429-6219ca8a5a14`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:43:27,623::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 11:43:27,624::task::595::TaskManager.Task::(_updateState) Task=`f4bb4228-93a9-4776-8d9c-21688148f180`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:43:27,626::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:43:27,627::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0273bd1b-f1ca-4b0b-8a17-281a05f1e833`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:43:27,628::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:43:27,628::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:43:27,629::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0273bd1b-f1ca-4b0b-8a17-281a05f1e833`::Granted request
>Thread-34::DEBUG::2014-08-21 11:43:27,630::task::827::TaskManager.Task::(resourceAcquired) Task=`f4bb4228-93a9-4776-8d9c-21688148f180`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:43:27,630::task::990::TaskManager.Task::(_decref) Task=`f4bb4228-93a9-4776-8d9c-21688148f180`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:43:27,638::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:27,638::task::1185::TaskManager.Task::(prepare) Task=`f4bb4228-93a9-4776-8d9c-21688148f180`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:27,639::task::595::TaskManager.Task::(_updateState) Task=`f4bb4228-93a9-4776-8d9c-21688148f180`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:43:27,640::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:43:27,640::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:43:27,642::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:43:27,643::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:43:27,643::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:43:27,644::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:43:27,644::task::990::TaskManager.Task::(_decref) Task=`f4bb4228-93a9-4776-8d9c-21688148f180`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:43:27,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.221591 s, 4.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:43:28,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:43:28,186::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00147371 s, 338 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:29,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:29,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0803198 s, 12.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:31,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:32,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.514804 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:37,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:43:38,288::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-26::DEBUG::2014-08-21 11:43:38,325::task::595::TaskManager.Task::(_updateState) Task=`b424511f-dd3d-4484-9b13-7bea8727dc61`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:43:38,326::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:43:38,327::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:43:38,327::task::1185::TaskManager.Task::(prepare) Task=`b424511f-dd3d-4484-9b13-7bea8727dc61`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:43:38,328::task::595::TaskManager.Task::(_updateState) Task=`b424511f-dd3d-4484-9b13-7bea8727dc61`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:43:38,328::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:43:38,352::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:43:38,352::task::990::TaskManager.Task::(_decref) Task=`b424511f-dd3d-4484-9b13-7bea8727dc61`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:43:39,839::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 11:43:39,900::task::595::TaskManager.Task::(_updateState) Task=`d120ea47-6cbd-4c49-b08e-054b087497cc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:43:39,953::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:43:40,037::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`035793a3-a1cd-4057-98f0-5ae1ab6dc91b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:43:40,037::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:43:40,194::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:43:40,206::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`035793a3-a1cd-4057-98f0-5ae1ab6dc91b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:43:40,334::task::827::TaskManager.Task::(resourceAcquired) Task=`d120ea47-6cbd-4c49-b08e-054b087497cc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:43:40,380::task::990::TaskManager.Task::(_decref) Task=`d120ea47-6cbd-4c49-b08e-054b087497cc`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:43:41,553::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:43:41,786::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:42,384::task::1185::TaskManager.Task::(prepare) Task=`d120ea47-6cbd-4c49-b08e-054b087497cc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:42,674::task::595::TaskManager.Task::(_updateState) Task=`d120ea47-6cbd-4c49-b08e-054b087497cc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:43:42,683::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:43:42,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 11:43:42,696::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00913847 s, 54.5 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:43:42,708::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:43:42,714::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:43:42,716::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:43:42,717::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:43:42,719::task::990::TaskManager.Task::(_decref) Task=`d120ea47-6cbd-4c49-b08e-054b087497cc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:43:42,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.88921 s, 209 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:45,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:43:45,475::task::595::TaskManager.Task::(_updateState) Task=`df2371dc-d02e-4177-a2f8-9664d0927c38`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:43:45,554::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:43:45,555::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00913847', 'lastCheck': '2.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:43:45,556::task::1185::TaskManager.Task::(prepare) Task=`df2371dc-d02e-4177-a2f8-9664d0927c38`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00913847', 'lastCheck': '2.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:43:45,556::task::595::TaskManager.Task::(_updateState) Task=`df2371dc-d02e-4177-a2f8-9664d0927c38`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:43:45,557::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:43:45,557::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:43:45,557::task::990::TaskManager.Task::(_decref) Task=`df2371dc-d02e-4177-a2f8-9664d0927c38`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:43:46,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.24978 s, 819 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:48,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:49,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.228809 s, 4.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:51,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:51,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.117408 s, 8.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:43:52,746::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-26::DEBUG::2014-08-21 11:43:52,748::task::595::TaskManager.Task::(_updateState) Task=`d57e965a-5ba8-453f-94a5-d7f9fa3ea636`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:43:52,748::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:43:52,749::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:43:52,749::task::1185::TaskManager.Task::(prepare) Task=`d57e965a-5ba8-453f-94a5-d7f9fa3ea636`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:43:52,750::task::595::TaskManager.Task::(_updateState) Task=`d57e965a-5ba8-453f-94a5-d7f9fa3ea636`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:43:52,750::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:43:52,752::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:43:52,752::task::990::TaskManager.Task::(_decref) Task=`d57e965a-5ba8-453f-94a5-d7f9fa3ea636`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:43:52,776::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:43:52,778::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 11:43:52,790::task::595::TaskManager.Task::(_updateState) Task=`38b82d55-0f67-4de1-8830-7034eb5b0870`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:43:52,791::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:43:52,793::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`11f36e5d-0024-4c31-be8d-b6c266eed611`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:43:52,794::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:43:52,796::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:43:52,797::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`11f36e5d-0024-4c31-be8d-b6c266eed611`::Granted request
>Thread-34::DEBUG::2014-08-21 11:43:52,799::task::827::TaskManager.Task::(resourceAcquired) Task=`38b82d55-0f67-4de1-8830-7034eb5b0870`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:43:52,800::task::990::TaskManager.Task::(_decref) Task=`38b82d55-0f67-4de1-8830-7034eb5b0870`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:43:52,805::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:52,806::task::1185::TaskManager.Task::(prepare) Task=`38b82d55-0f67-4de1-8830-7034eb5b0870`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:43:52,806::task::595::TaskManager.Task::(_updateState) Task=`38b82d55-0f67-4de1-8830-7034eb5b0870`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:43:52,807::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:43:52,808::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:43:52,808::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:43:52,808::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:43:52,809::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:43:52,809::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:43:52,809::task::990::TaskManager.Task::(_decref) Task=`38b82d55-0f67-4de1-8830-7034eb5b0870`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:43:52,815::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00299894 s, 166 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:53,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:53,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.063746 s, 16.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:55,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:55,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10403 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:57,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:43:57,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124895 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:43:59,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:00,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0853281 s, 12.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:44:01,217::task::595::TaskManager.Task::(_updateState) Task=`1d0ed52b-07d1-4d99-a731-d70f01029556`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:44:01,218::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:44:01,218::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00299894', 'lastCheck': '8.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:44:01,219::task::1185::TaskManager.Task::(prepare) Task=`1d0ed52b-07d1-4d99-a731-d70f01029556`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00299894', 'lastCheck': '8.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:44:01,219::task::595::TaskManager.Task::(_updateState) Task=`1d0ed52b-07d1-4d99-a731-d70f01029556`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:44:01,219::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:44:01,219::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:44:01,220::task::990::TaskManager.Task::(_decref) Task=`1d0ed52b-07d1-4d99-a731-d70f01029556`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:44:02,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:44:02,835::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-26::DEBUG::2014-08-21 11:44:02,847::task::595::TaskManager.Task::(_updateState) Task=`87f16f98-723e-449d-9fe2-01fbff8405b0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:44:02,853::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:44:02,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:44:02,867::task::1185::TaskManager.Task::(prepare) Task=`87f16f98-723e-449d-9fe2-01fbff8405b0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:44:02,871::task::595::TaskManager.Task::(_updateState) Task=`87f16f98-723e-449d-9fe2-01fbff8405b0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:44:02,875::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:44:02,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:44:02,883::task::990::TaskManager.Task::(_decref) Task=`87f16f98-723e-449d-9fe2-01fbff8405b0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:44:02,904::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-34::DEBUG::2014-08-21 11:44:02,913::task::595::TaskManager.Task::(_updateState) Task=`1ddd14ec-f759-49c5-9982-956b6e73ed9e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:44:02,919::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:44:02,931::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`50991a89-2dae-48bc-acd5-4aa642954c8e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:44:02,933::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:44:02,937::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:44:02,939::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`50991a89-2dae-48bc-acd5-4aa642954c8e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:44:02,946::task::827::TaskManager.Task::(resourceAcquired) Task=`1ddd14ec-f759-49c5-9982-956b6e73ed9e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:44:02,950::task::990::TaskManager.Task::(_decref) Task=`1ddd14ec-f759-49c5-9982-956b6e73ed9e`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:44:03,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:44:03,034::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:03,038::task::1185::TaskManager.Task::(prepare) Task=`1ddd14ec-f759-49c5-9982-956b6e73ed9e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:03,041::task::595::TaskManager.Task::(_updateState) Task=`1ddd14ec-f759-49c5-9982-956b6e73ed9e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:44:03,045::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:44:03,049::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 11:44:03,055::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00067994 s, 732 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:44:03,061::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:44:03,081::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:44:03,086::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:44:03,088::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:44:03,091::task::990::TaskManager.Task::(_decref) Task=`1ddd14ec-f759-49c5-9982-956b6e73ed9e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:44:03,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.176794 s, 5.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:05,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:05,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0998091 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:07,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:08,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.956632 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:10,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:10,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047938 s, 21.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:12,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:12,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0670594 s, 15.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:44:13,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:44:13,128::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-26::DEBUG::2014-08-21 11:44:13,129::task::595::TaskManager.Task::(_updateState) Task=`3b9c7da1-7a13-4a53-9330-bfdc12acd7d9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:44:13,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:44:13,130::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:44:13,130::task::1185::TaskManager.Task::(prepare) Task=`3b9c7da1-7a13-4a53-9330-bfdc12acd7d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:44:13,130::task::595::TaskManager.Task::(_updateState) Task=`3b9c7da1-7a13-4a53-9330-bfdc12acd7d9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:44:13,131::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:44:13,131::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:44:13,131::task::990::TaskManager.Task::(_decref) Task=`3b9c7da1-7a13-4a53-9330-bfdc12acd7d9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:44:13,140::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-34::DEBUG::2014-08-21 11:44:13,143::task::595::TaskManager.Task::(_updateState) Task=`29e5fb70-4b2a-4ea4-bc78-05fa1cd559d5`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 11:44:13,144::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000482104 s, 1.0 MB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:44:13,146::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:44:13,152::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eee28be7-67eb-433a-b324-e67b4b7f546b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:44:13,153::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:44:13,153::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:44:13,154::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eee28be7-67eb-433a-b324-e67b4b7f546b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:44:13,157::task::827::TaskManager.Task::(resourceAcquired) Task=`29e5fb70-4b2a-4ea4-bc78-05fa1cd559d5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:44:13,159::task::990::TaskManager.Task::(_decref) Task=`29e5fb70-4b2a-4ea4-bc78-05fa1cd559d5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:44:13,169::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:13,170::task::1185::TaskManager.Task::(prepare) Task=`29e5fb70-4b2a-4ea4-bc78-05fa1cd559d5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:13,170::task::595::TaskManager.Task::(_updateState) Task=`29e5fb70-4b2a-4ea4-bc78-05fa1cd559d5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:44:13,170::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:44:13,170::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:44:13,171::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:44:13,171::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:44:13,171::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:44:13,171::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:44:13,172::task::990::TaskManager.Task::(_decref) Task=`29e5fb70-4b2a-4ea4-bc78-05fa1cd559d5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:44:14,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:15,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.13939 s, 7.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:17,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:17,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0758026 s, 13.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:44:18,208::task::595::TaskManager.Task::(_updateState) Task=`b3c4ac9c-c99c-4dc2-8b18-af97ae2d444a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:44:18,209::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:44:18,210::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482104', 'lastCheck': '5.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:44:18,210::task::1185::TaskManager.Task::(prepare) Task=`b3c4ac9c-c99c-4dc2-8b18-af97ae2d444a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482104', 'lastCheck': '5.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:44:18,211::task::595::TaskManager.Task::(_updateState) Task=`b3c4ac9c-c99c-4dc2-8b18-af97ae2d444a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:44:18,211::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:44:18,211::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:44:18,212::task::990::TaskManager.Task::(_decref) Task=`b3c4ac9c-c99c-4dc2-8b18-af97ae2d444a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:44:19,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:19,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.109342 s, 9.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:21,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:22,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.136928 s, 7.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:44:23,196::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-26::DEBUG::2014-08-21 11:44:23,206::task::595::TaskManager.Task::(_updateState) Task=`513501f5-f8d4-439f-89e6-af5684feada0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:44:23,206::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:44:23,207::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:44:23,207::task::1185::TaskManager.Task::(prepare) Task=`513501f5-f8d4-439f-89e6-af5684feada0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:44:23,208::task::595::TaskManager.Task::(_updateState) Task=`513501f5-f8d4-439f-89e6-af5684feada0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:44:23,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:44:23,208::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:44:23,209::task::990::TaskManager.Task::(_decref) Task=`513501f5-f8d4-439f-89e6-af5684feada0`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:44:23,304::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:44:23,466::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-34::DEBUG::2014-08-21 11:44:23,467::task::595::TaskManager.Task::(_updateState) Task=`0f7491e3-6629-43f8-a4ff-118a86dc1393`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:44:23,468::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:44:23,503::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7789eda9-1d03-4d9f-a834-ac296b09dff9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:44:23,504::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:44:23,504::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:44:23,505::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7789eda9-1d03-4d9f-a834-ac296b09dff9`::Granted request
>Thread-34::DEBUG::2014-08-21 11:44:23,506::task::827::TaskManager.Task::(resourceAcquired) Task=`0f7491e3-6629-43f8-a4ff-118a86dc1393`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:44:23,506::task::990::TaskManager.Task::(_decref) Task=`0f7491e3-6629-43f8-a4ff-118a86dc1393`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:44:23,561::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:23,561::task::1185::TaskManager.Task::(prepare) Task=`0f7491e3-6629-43f8-a4ff-118a86dc1393`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:23,562::task::595::TaskManager.Task::(_updateState) Task=`0f7491e3-6629-43f8-a4ff-118a86dc1393`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:44:23,576::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:44:23,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:44:23,578::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:44:23,578::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:44:23,578::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:44:23,579::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:44:23,579::task::990::TaskManager.Task::(_decref) Task=`0f7491e3-6629-43f8-a4ff-118a86dc1393`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:44:24,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:44:24,347::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.195637 s, 2.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:25,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.940102 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:27,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:44:38,391::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-13::DEBUG::2014-08-21 11:44:38,698::task::595::TaskManager.Task::(_updateState) Task=`ee93fe27-17fd-4384-bd68-01d981347cfb`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:44:38,788::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:44:38,789::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:44:38,789::task::1185::TaskManager.Task::(prepare) Task=`ee93fe27-17fd-4384-bd68-01d981347cfb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:44:38,790::task::595::TaskManager.Task::(_updateState) Task=`ee93fe27-17fd-4384-bd68-01d981347cfb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:44:38,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:44:38,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:44:38,791::task::990::TaskManager.Task::(_decref) Task=`ee93fe27-17fd-4384-bd68-01d981347cfb`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:44:40,415::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-34::DEBUG::2014-08-21 11:44:40,425::task::595::TaskManager.Task::(_updateState) Task=`3083e60b-73e1-4c54-916c-885f37bdabf9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:44:40,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:44:40,444::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`14a1ca05-e4d3-4c6c-ab61-46968214106b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:44:40,448::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:44:40,455::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-15::DEBUG::2014-08-21 11:44:40,459::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:44:40,460::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`14a1ca05-e4d3-4c6c-ab61-46968214106b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:44:40,482::task::827::TaskManager.Task::(resourceAcquired) Task=`3083e60b-73e1-4c54-916c-885f37bdabf9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:44:40,485::task::990::TaskManager.Task::(_decref) Task=`3083e60b-73e1-4c54-916c-885f37bdabf9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:44:40,524::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:40,526::task::1185::TaskManager.Task::(prepare) Task=`3083e60b-73e1-4c54-916c-885f37bdabf9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:40,528::task::595::TaskManager.Task::(_updateState) Task=`3083e60b-73e1-4c54-916c-885f37bdabf9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:44:40,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:44:40,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:44:40,535::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:44:40,539::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:44:40,540::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:44:40,542::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:44:40,545::task::990::TaskManager.Task::(_decref) Task=`3083e60b-73e1-4c54-916c-885f37bdabf9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:44:40,569::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000425609 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:40,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.29691 s, 311 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:42,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:42,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0916763 s, 11.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:44,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:45,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0635641 s, 16.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:44:45,698::task::595::TaskManager.Task::(_updateState) Task=`3bf08f80-e67f-4778-9989-a4ffb5aca036`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:44:45,698::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:44:45,699::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425609', 'lastCheck': '5.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:44:45,699::task::1185::TaskManager.Task::(prepare) Task=`3bf08f80-e67f-4778-9989-a4ffb5aca036`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425609', 'lastCheck': '5.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:44:45,699::task::595::TaskManager.Task::(_updateState) Task=`3bf08f80-e67f-4778-9989-a4ffb5aca036`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:44:45,700::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:44:45,700::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:44:45,700::task::990::TaskManager.Task::(_decref) Task=`3bf08f80-e67f-4778-9989-a4ffb5aca036`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:44:47,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:47,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.442228 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:50,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:44:50,695::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-13::DEBUG::2014-08-21 11:44:50,726::task::595::TaskManager.Task::(_updateState) Task=`bcb0447b-6f00-4010-989f-b2f6f8c4c804`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:44:51,276::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:44:51,278::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:44:51,278::task::1185::TaskManager.Task::(prepare) Task=`bcb0447b-6f00-4010-989f-b2f6f8c4c804`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:44:51,279::task::595::TaskManager.Task::(_updateState) Task=`bcb0447b-6f00-4010-989f-b2f6f8c4c804`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:44:52,510::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:44:52,521::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:44:52,537::task::990::TaskManager.Task::(_decref) Task=`bcb0447b-6f00-4010-989f-b2f6f8c4c804`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:44:52,595::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-34::DEBUG::2014-08-21 11:44:52,598::task::595::TaskManager.Task::(_updateState) Task=`d94d28ad-86bb-4308-ad13-e774c76703c1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:44:52,601::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:44:52,607::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`12b60209-78e5-467e-a475-0dce83b8fcb0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:44:52,608::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:44:52,612::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:44:52,613::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`12b60209-78e5-467e-a475-0dce83b8fcb0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:44:52,618::task::827::TaskManager.Task::(resourceAcquired) Task=`d94d28ad-86bb-4308-ad13-e774c76703c1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:44:52,620::task::990::TaskManager.Task::(_decref) Task=`d94d28ad-86bb-4308-ad13-e774c76703c1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:44:52,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:52,661::task::1185::TaskManager.Task::(prepare) Task=`d94d28ad-86bb-4308-ad13-e774c76703c1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:44:52,665::task::595::TaskManager.Task::(_updateState) Task=`d94d28ad-86bb-4308-ad13-e774c76703c1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:44:52,668::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:44:52,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:44:52,673::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:44:52,675::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:44:52,677::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:44:52,678::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:44:52,683::task::990::TaskManager.Task::(_decref) Task=`d94d28ad-86bb-4308-ad13-e774c76703c1`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:44:52,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:44:52,768::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000399725 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:52,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.70406 s, 379 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:54,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:55,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.452354 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:57,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:57,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0737627 s, 13.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:44:59,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:44:59,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0699638 s, 14.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:45:01,565::task::595::TaskManager.Task::(_updateState) Task=`89029cb3-3335-44ae-b1d7-fd89da217017`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:45:01,566::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:45:01,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399725', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:45:01,566::task::1185::TaskManager.Task::(prepare) Task=`89029cb3-3335-44ae-b1d7-fd89da217017`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399725', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:45:01,567::task::595::TaskManager.Task::(_updateState) Task=`89029cb3-3335-44ae-b1d7-fd89da217017`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:45:01,567::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:45:01,567::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:45:01,567::task::990::TaskManager.Task::(_decref) Task=`89029cb3-3335-44ae-b1d7-fd89da217017`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:45:01,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:02,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0566842 s, 18.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:45:02,711::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [56d6be71]
>Thread-13::DEBUG::2014-08-21 11:45:02,712::task::595::TaskManager.Task::(_updateState) Task=`43eb2580-09ec-4adf-bed7-39d70a51eab6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:45:02,712::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:45:02,713::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:45:02,713::task::1185::TaskManager.Task::(prepare) Task=`43eb2580-09ec-4adf-bed7-39d70a51eab6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:45:02,713::task::595::TaskManager.Task::(_updateState) Task=`43eb2580-09ec-4adf-bed7-39d70a51eab6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:45:02,713::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:45:02,714::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:45:02,714::task::990::TaskManager.Task::(_decref) Task=`43eb2580-09ec-4adf-bed7-39d70a51eab6`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:45:02,720::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [56d6be71]
>Thread-34::DEBUG::2014-08-21 11:45:02,721::task::595::TaskManager.Task::(_updateState) Task=`760f3c37-c59b-4fb2-b633-1798fb453dc7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:45:02,722::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:45:02,723::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`99a896f7-712c-4176-ae21-ed31c4f9a7e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:45:02,723::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:45:02,724::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:45:02,724::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`99a896f7-712c-4176-ae21-ed31c4f9a7e7`::Granted request
>Thread-34::DEBUG::2014-08-21 11:45:02,725::task::827::TaskManager.Task::(resourceAcquired) Task=`760f3c37-c59b-4fb2-b633-1798fb453dc7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:45:02,726::task::990::TaskManager.Task::(_decref) Task=`760f3c37-c59b-4fb2-b633-1798fb453dc7`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:45:02,733::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:02,734::task::1185::TaskManager.Task::(prepare) Task=`760f3c37-c59b-4fb2-b633-1798fb453dc7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:02,734::task::595::TaskManager.Task::(_updateState) Task=`760f3c37-c59b-4fb2-b633-1798fb453dc7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:45:02,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:45:02,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:45:02,735::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:45:02,736::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:45:02,736::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:45:02,736::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:45:02,737::task::990::TaskManager.Task::(_decref) Task=`760f3c37-c59b-4fb2-b633-1798fb453dc7`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:45:03,356::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:45:03,393::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00786113 s, 63.3 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:04,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:04,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0908012 s, 11.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:06,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:06,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.2096 s, 4.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:08,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:08,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.204282 s, 5.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:10,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:11,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.393548 s, 2.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:45:12,762::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-13::DEBUG::2014-08-21 11:45:12,768::task::595::TaskManager.Task::(_updateState) Task=`7a7235ad-52e0-4a08-b2de-81568afd506a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:45:12,772::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:45:12,783::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:45:12,785::task::1185::TaskManager.Task::(prepare) Task=`7a7235ad-52e0-4a08-b2de-81568afd506a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:45:12,786::task::595::TaskManager.Task::(_updateState) Task=`7a7235ad-52e0-4a08-b2de-81568afd506a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:45:12,787::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:45:12,787::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:45:12,787::task::990::TaskManager.Task::(_decref) Task=`7a7235ad-52e0-4a08-b2de-81568afd506a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:45:12,793::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-34::DEBUG::2014-08-21 11:45:12,794::task::595::TaskManager.Task::(_updateState) Task=`d8c3f4a3-46d4-4893-be1e-d5af9c2e708e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:45:12,795::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:45:12,796::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`21629f62-d6f8-4684-8e44-9568dce497b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:45:12,797::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:45:12,797::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:45:12,798::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`21629f62-d6f8-4684-8e44-9568dce497b0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:45:12,799::task::827::TaskManager.Task::(resourceAcquired) Task=`d8c3f4a3-46d4-4893-be1e-d5af9c2e708e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:45:12,799::task::990::TaskManager.Task::(_decref) Task=`d8c3f4a3-46d4-4893-be1e-d5af9c2e708e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:45:12,803::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:12,803::task::1185::TaskManager.Task::(prepare) Task=`d8c3f4a3-46d4-4893-be1e-d5af9c2e708e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:12,804::task::595::TaskManager.Task::(_updateState) Task=`d8c3f4a3-46d4-4893-be1e-d5af9c2e708e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:45:12,804::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:45:12,804::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:45:12,804::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:45:12,805::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:45:12,805::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:45:12,805::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:45:12,806::task::990::TaskManager.Task::(_decref) Task=`d8c3f4a3-46d4-4893-be1e-d5af9c2e708e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:45:13,480::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:45:13,540::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000868323 s, 574 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:13,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:13,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0970649 s, 10.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:15,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:45:16,918::task::595::TaskManager.Task::(_updateState) Task=`9ae11f20-5e02-4123-acea-840fe3e15316`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:45:17,135::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:45:17,140::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000868323', 'lastCheck': '3.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:45:17,141::task::1185::TaskManager.Task::(prepare) Task=`9ae11f20-5e02-4123-acea-840fe3e15316`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000868323', 'lastCheck': '3.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:45:17,141::task::595::TaskManager.Task::(_updateState) Task=`9ae11f20-5e02-4123-acea-840fe3e15316`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:45:17,141::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:45:17,142::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:45:17,142::task::990::TaskManager.Task::(_decref) Task=`9ae11f20-5e02-4123-acea-840fe3e15316`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:45:18,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.02809 s, 338 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:20,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:45:22,889::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-26::DEBUG::2014-08-21 11:45:22,894::task::595::TaskManager.Task::(_updateState) Task=`fb4cafbe-127b-4f05-bd94-02ef148ce0e8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:45:22,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:45:22,898::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:45:22,898::task::1185::TaskManager.Task::(prepare) Task=`fb4cafbe-127b-4f05-bd94-02ef148ce0e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:45:22,898::task::595::TaskManager.Task::(_updateState) Task=`fb4cafbe-127b-4f05-bd94-02ef148ce0e8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:45:22,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:45:22,899::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:45:22,899::task::990::TaskManager.Task::(_decref) Task=`fb4cafbe-127b-4f05-bd94-02ef148ce0e8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:45:23,049::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-34::DEBUG::2014-08-21 11:45:23,051::task::595::TaskManager.Task::(_updateState) Task=`9b4d183d-4584-4a38-a855-c8500f8da6c5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:45:23,051::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:45:23,052::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`150917fa-cb0a-4b94-a134-87cd1eba77ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:45:23,052::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:45:23,053::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:45:23,053::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`150917fa-cb0a-4b94-a134-87cd1eba77ca`::Granted request
>Thread-34::DEBUG::2014-08-21 11:45:23,080::task::827::TaskManager.Task::(resourceAcquired) Task=`9b4d183d-4584-4a38-a855-c8500f8da6c5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:45:23,081::task::990::TaskManager.Task::(_decref) Task=`9b4d183d-4584-4a38-a855-c8500f8da6c5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:45:23,089::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:23,089::task::1185::TaskManager.Task::(prepare) Task=`9b4d183d-4584-4a38-a855-c8500f8da6c5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:23,090::task::595::TaskManager.Task::(_updateState) Task=`9b4d183d-4584-4a38-a855-c8500f8da6c5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:45:23,090::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:45:23,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:45:23,189::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:45:23,512::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:45:23,512::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:45:23,513::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:45:23,513::task::990::TaskManager.Task::(_decref) Task=`9b4d183d-4584-4a38-a855-c8500f8da6c5`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:45:23,702::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:45:23,797::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000510894 s, 975 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:23,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.64925 s, 387 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:25,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:26,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0585678 s, 17.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:28,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:28,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.382626 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:30,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:30,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.058934 s, 17.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:32,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:32,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425196 s, 24.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:45:33,570::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-13::DEBUG::2014-08-21 11:45:33,572::task::595::TaskManager.Task::(_updateState) Task=`a43f8c50-d402-419d-a70f-0386b9842b8f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:45:33,585::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:45:33,587::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:45:33,587::task::1185::TaskManager.Task::(prepare) Task=`a43f8c50-d402-419d-a70f-0386b9842b8f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:45:33,587::task::595::TaskManager.Task::(_updateState) Task=`a43f8c50-d402-419d-a70f-0386b9842b8f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:45:33,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:45:33,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:45:33,589::task::990::TaskManager.Task::(_decref) Task=`a43f8c50-d402-419d-a70f-0386b9842b8f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:45:35,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-34::DEBUG::2014-08-21 11:45:35,069::task::595::TaskManager.Task::(_updateState) Task=`a97b443c-4028-45fb-bc26-d1d593a8b2dc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:45:35,084::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:45:35,108::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eaf27802-114f-437f-b222-a967b5c02f07`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Dummy-33::DEBUG::2014-08-21 11:45:35,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:45:35,118::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-13::DEBUG::2014-08-21 11:45:35,237::task::595::TaskManager.Task::(_updateState) Task=`86eb098a-1cae-44a9-9830-8eea6a47def6`::moving from state init -> state preparing
>Thread-34::DEBUG::2014-08-21 11:45:35,373::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-13::INFO::2014-08-21 11:45:35,385::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-15::DEBUG::2014-08-21 11:45:35,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::INFO::2014-08-21 11:45:35,447::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510894', 'lastCheck': '11.6', 'valid': True}}
>Thread-34::DEBUG::2014-08-21 11:45:35,449::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eaf27802-114f-437f-b222-a967b5c02f07`::Granted request
>Thread-13::DEBUG::2014-08-21 11:45:35,461::task::1185::TaskManager.Task::(prepare) Task=`86eb098a-1cae-44a9-9830-8eea6a47def6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510894', 'lastCheck': '11.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:45:35,473::task::595::TaskManager.Task::(_updateState) Task=`86eb098a-1cae-44a9-9830-8eea6a47def6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:45:35,478::task::827::TaskManager.Task::(resourceAcquired) Task=`a97b443c-4028-45fb-bc26-d1d593a8b2dc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-13::DEBUG::2014-08-21 11:45:35,479::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-15::DEBUG::2014-08-21 11:45:35,483::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0010594 s, 470 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:45:35,482::task::990::TaskManager.Task::(_decref) Task=`a97b443c-4028-45fb-bc26-d1d593a8b2dc`::ref 1 aborting False
>Thread-13::DEBUG::2014-08-21 11:45:35,482::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:45:35,497::task::990::TaskManager.Task::(_decref) Task=`86eb098a-1cae-44a9-9830-8eea6a47def6`::ref 0 aborting False
>Thread-34::INFO::2014-08-21 11:45:35,569::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:35,571::task::1185::TaskManager.Task::(prepare) Task=`a97b443c-4028-45fb-bc26-d1d593a8b2dc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:35,573::task::595::TaskManager.Task::(_updateState) Task=`a97b443c-4028-45fb-bc26-d1d593a8b2dc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:45:35,575::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:45:35,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:45:35,581::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:45:35,585::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:45:35,587::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:45:35,589::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:45:35,594::task::990::TaskManager.Task::(_decref) Task=`a97b443c-4028-45fb-bc26-d1d593a8b2dc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:45:35,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.28914 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:37,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:37,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0737106 s, 13.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:39,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:40,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.115209 s, 8.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:42,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:45:42,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.081052 s, 12.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:45:44,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:45:45,876::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5382417d]
>Thread-13::DEBUG::2014-08-21 11:45:45,878::task::595::TaskManager.Task::(_updateState) Task=`733895bf-ee93-4fba-bd46-4b47029c0897`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:45:45,923::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:45:45,924::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:45:45,925::task::1185::TaskManager.Task::(prepare) Task=`733895bf-ee93-4fba-bd46-4b47029c0897`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:45:45,937::task::595::TaskManager.Task::(_updateState) Task=`733895bf-ee93-4fba-bd46-4b47029c0897`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:45:45,965::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:45:46,004::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:45:46,170::task::990::TaskManager.Task::(_decref) Task=`733895bf-ee93-4fba-bd46-4b47029c0897`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:45:47,100::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5382417d]
>Thread-34::DEBUG::2014-08-21 11:45:48,093::task::595::TaskManager.Task::(_updateState) Task=`8e94b2ed-0092-4e11-998e-97908ff2251e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:45:48,253::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:45:48,260::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`34b6abd0-4521-4216-8d7a-74c5fa648e9e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:45:48,261::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:45:48,264::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:45:48,266::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`34b6abd0-4521-4216-8d7a-74c5fa648e9e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:45:48,271::task::827::TaskManager.Task::(resourceAcquired) Task=`8e94b2ed-0092-4e11-998e-97908ff2251e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:45:48,272::task::990::TaskManager.Task::(_decref) Task=`8e94b2ed-0092-4e11-998e-97908ff2251e`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:45:48,380::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:45:48,409::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:48,586::task::1185::TaskManager.Task::(prepare) Task=`8e94b2ed-0092-4e11-998e-97908ff2251e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894884352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:45:48,689::task::595::TaskManager.Task::(_updateState) Task=`8e94b2ed-0092-4e11-998e-97908ff2251e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:45:48,739::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:45:48,771::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 11:45:48,787::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0145769 s, 34.2 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:45:48,849::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:45:53,321::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:45:53,322::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:45:53,322::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:45:53,323::task::990::TaskManager.Task::(_decref) Task=`8e94b2ed-0092-4e11-998e-97908ff2251e`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:46:01,299::task::595::TaskManager.Task::(_updateState) Task=`916d50ac-6034-4a03-9793-8632c60efc53`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:46:01,303::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:46:01,307::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0145769', 'lastCheck': '0.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:46:01,309::task::1185::TaskManager.Task::(prepare) Task=`916d50ac-6034-4a03-9793-8632c60efc53`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0145769', 'lastCheck': '0.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:46:01,310::task::595::TaskManager.Task::(_updateState) Task=`916d50ac-6034-4a03-9793-8632c60efc53`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:46:01,311::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:46:01,311::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:46:01,312::task::990::TaskManager.Task::(_decref) Task=`916d50ac-6034-4a03-9793-8632c60efc53`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:46:01,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.56647 s, 120 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:03,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:46:04,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.363556 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:06,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:46:10,675::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-13::DEBUG::2014-08-21 11:46:10,676::task::595::TaskManager.Task::(_updateState) Task=`eac3e3dc-6186-496a-a737-039bc17af59c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:46:10,677::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:46:10,701::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:46:10,701::task::1185::TaskManager.Task::(prepare) Task=`eac3e3dc-6186-496a-a737-039bc17af59c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:46:10,702::task::595::TaskManager.Task::(_updateState) Task=`eac3e3dc-6186-496a-a737-039bc17af59c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:46:10,702::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:46:10,703::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:46:10,703::task::990::TaskManager.Task::(_decref) Task=`eac3e3dc-6186-496a-a737-039bc17af59c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:46:10,923::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-34::DEBUG::2014-08-21 11:46:10,943::task::595::TaskManager.Task::(_updateState) Task=`516c9444-7333-4f62-9b8c-998226a4fcdf`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:46:10,951::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:46:10,953::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`890abcb8-7975-4774-91aa-5264c800fc78`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:46:10,954::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:46:10,956::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:46:10,972::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`890abcb8-7975-4774-91aa-5264c800fc78`::Granted request
>Thread-34::DEBUG::2014-08-21 11:46:10,999::task::827::TaskManager.Task::(resourceAcquired) Task=`516c9444-7333-4f62-9b8c-998226a4fcdf`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:46:11,010::task::990::TaskManager.Task::(_decref) Task=`516c9444-7333-4f62-9b8c-998226a4fcdf`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:46:13,885::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:13,924::task::1185::TaskManager.Task::(prepare) Task=`516c9444-7333-4f62-9b8c-998226a4fcdf`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:13,925::task::595::TaskManager.Task::(_updateState) Task=`516c9444-7333-4f62-9b8c-998226a4fcdf`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:46:13,932::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:46:13,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:46:14,004::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:46:14,017::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:46:14,018::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:46:14,018::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:46:14,024::task::990::TaskManager.Task::(_decref) Task=`516c9444-7333-4f62-9b8c-998226a4fcdf`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:46:14,451::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:46:14,626::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00961677 s, 51.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:14,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.33402 s, 439 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:16,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:46:16,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0706807 s, 14.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:19,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:46:21,174::task::595::TaskManager.Task::(_updateState) Task=`8c88cbd8-4dc2-4afe-acd1-8456fee7ed40`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:46:21,175::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:46:21,176::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00961677', 'lastCheck': '6.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:46:21,208::task::1185::TaskManager.Task::(prepare) Task=`8c88cbd8-4dc2-4afe-acd1-8456fee7ed40`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00961677', 'lastCheck': '6.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:46:21,226::task::595::TaskManager.Task::(_updateState) Task=`8c88cbd8-4dc2-4afe-acd1-8456fee7ed40`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:46:21,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:46:21,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:46:21,512::task::990::TaskManager.Task::(_decref) Task=`8c88cbd8-4dc2-4afe-acd1-8456fee7ed40`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:46:22,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.84079 s, 360 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:24,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:46:24,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-13::DEBUG::2014-08-21 11:46:24,458::task::595::TaskManager.Task::(_updateState) Task=`8ff8c732-c711-429c-9a86-5c1dd943e5c9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:46:24,458::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:46:24,472::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:46:24,473::task::1185::TaskManager.Task::(prepare) Task=`8ff8c732-c711-429c-9a86-5c1dd943e5c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:46:24,473::task::595::TaskManager.Task::(_updateState) Task=`8ff8c732-c711-429c-9a86-5c1dd943e5c9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:46:24,474::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:46:24,474::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:46:24,474::task::990::TaskManager.Task::(_decref) Task=`8ff8c732-c711-429c-9a86-5c1dd943e5c9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:46:24,484::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-34::DEBUG::2014-08-21 11:46:24,485::task::595::TaskManager.Task::(_updateState) Task=`0a120d9b-a755-4eba-833f-ece6399ebe05`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:46:24,485::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:46:24,487::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4c862999-a128-48a9-8059-36734a6a49bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:46:24,488::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:46:24,489::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:46:24,489::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4c862999-a128-48a9-8059-36734a6a49bc`::Granted request
>Thread-34::DEBUG::2014-08-21 11:46:24,491::task::827::TaskManager.Task::(resourceAcquired) Task=`0a120d9b-a755-4eba-833f-ece6399ebe05`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:46:24,491::task::990::TaskManager.Task::(_decref) Task=`0a120d9b-a755-4eba-833f-ece6399ebe05`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:46:24,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:24,501::task::1185::TaskManager.Task::(prepare) Task=`0a120d9b-a755-4eba-833f-ece6399ebe05`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:24,502::task::595::TaskManager.Task::(_updateState) Task=`0a120d9b-a755-4eba-833f-ece6399ebe05`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:46:24,502::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:46:24,502::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:46:24,503::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:46:24,503::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:46:24,504::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:46:24,504::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:46:24,505::task::990::TaskManager.Task::(_decref) Task=`0a120d9b-a755-4eba-833f-ece6399ebe05`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:46:26,555::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:46:26,940::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000842264 s, 591 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:27,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.5621 s, 400 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:29,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:46:29,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490671 s, 20.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:31,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:46:33,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.06843 s, 958 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:46:34,594::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-26::DEBUG::2014-08-21 11:46:34,596::task::595::TaskManager.Task::(_updateState) Task=`1ab9b5ca-1cbf-4f5c-b5c5-73971ba4454c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:46:34,596::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:46:34,597::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:46:34,597::task::1185::TaskManager.Task::(prepare) Task=`1ab9b5ca-1cbf-4f5c-b5c5-73971ba4454c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:46:34,597::task::595::TaskManager.Task::(_updateState) Task=`1ab9b5ca-1cbf-4f5c-b5c5-73971ba4454c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:46:34,598::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:46:34,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:46:34,620::task::990::TaskManager.Task::(_decref) Task=`1ab9b5ca-1cbf-4f5c-b5c5-73971ba4454c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:46:34,636::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48d94cfa]
>Thread-34::DEBUG::2014-08-21 11:46:34,638::task::595::TaskManager.Task::(_updateState) Task=`ef266468-07c9-4b76-b30b-5b0b3b5e1946`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:46:34,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:46:34,640::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`19f6d1ad-ffde-4e9a-8d7e-fb914f5bad26`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:46:34,640::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:46:34,641::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:46:34,641::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`19f6d1ad-ffde-4e9a-8d7e-fb914f5bad26`::Granted request
>Thread-34::DEBUG::2014-08-21 11:46:34,642::task::827::TaskManager.Task::(resourceAcquired) Task=`ef266468-07c9-4b76-b30b-5b0b3b5e1946`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:46:34,642::task::990::TaskManager.Task::(_decref) Task=`ef266468-07c9-4b76-b30b-5b0b3b5e1946`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:46:34,651::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:34,651::task::1185::TaskManager.Task::(prepare) Task=`ef266468-07c9-4b76-b30b-5b0b3b5e1946`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:34,652::task::595::TaskManager.Task::(_updateState) Task=`ef266468-07c9-4b76-b30b-5b0b3b5e1946`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:46:34,652::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:46:34,653::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:46:34,653::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:46:34,654::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:46:34,654::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:46:34,654::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:46:34,654::task::990::TaskManager.Task::(_decref) Task=`ef266468-07c9-4b76-b30b-5b0b3b5e1946`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:46:35,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:46:35,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.115319 s, 8.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:46:37,591::task::595::TaskManager.Task::(_updateState) Task=`4878ec04-e899-4ebc-a1fa-cafb682ecc13`::moving from state init -> state preparing
>Dummy-33::DEBUG::2014-08-21 11:46:37,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::INFO::2014-08-21 11:46:37,700::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:46:37,722::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000842264', 'lastCheck': '10.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:46:37,731::task::1185::TaskManager.Task::(prepare) Task=`4878ec04-e899-4ebc-a1fa-cafb682ecc13`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000842264', 'lastCheck': '10.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:46:37,733::task::595::TaskManager.Task::(_updateState) Task=`4878ec04-e899-4ebc-a1fa-cafb682ecc13`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:46:37,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:46:37,741::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:46:37,757::task::990::TaskManager.Task::(_decref) Task=`4878ec04-e899-4ebc-a1fa-cafb682ecc13`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:46:38,025::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:46:38,864::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00509672 s, 97.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:39,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.5559 s, 658 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:41,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:46:41,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0702428 s, 14.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:43,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:46:43,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112999 s, 9.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:46:45,720::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Dummy-33::DEBUG::2014-08-21 11:46:46,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:46:46,530::task::595::TaskManager.Task::(_updateState) Task=`adf06c97-d8a5-44dd-8e52-333a2985b21e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:46:46,898::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:46:47,345::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:46:47,457::task::1185::TaskManager.Task::(prepare) Task=`adf06c97-d8a5-44dd-8e52-333a2985b21e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:46:47,457::task::595::TaskManager.Task::(_updateState) Task=`adf06c97-d8a5-44dd-8e52-333a2985b21e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:46:47,458::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:46:47,458::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:46:47,459::task::990::TaskManager.Task::(_decref) Task=`adf06c97-d8a5-44dd-8e52-333a2985b21e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:46:47,528::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 11:46:47,538::task::595::TaskManager.Task::(_updateState) Task=`b38b0b00-a144-4a7b-9ec3-84af25c3bdff`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:46:47,538::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:46:47,539::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f9064c63-0b54-4f07-bcb3-e84559efedec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:46:47,539::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:46:47,540::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:46:47,541::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f9064c63-0b54-4f07-bcb3-e84559efedec`::Granted request
>Thread-34::DEBUG::2014-08-21 11:46:47,542::task::827::TaskManager.Task::(resourceAcquired) Task=`b38b0b00-a144-4a7b-9ec3-84af25c3bdff`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:46:47,542::task::990::TaskManager.Task::(_decref) Task=`b38b0b00-a144-4a7b-9ec3-84af25c3bdff`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:46:47,556::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:47,557::task::1185::TaskManager.Task::(prepare) Task=`b38b0b00-a144-4a7b-9ec3-84af25c3bdff`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:47,557::task::595::TaskManager.Task::(_updateState) Task=`b38b0b00-a144-4a7b-9ec3-84af25c3bdff`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:46:47,558::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:46:47,558::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:46:47,559::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:46:47,559::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:46:47,559::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:46:47,560::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:46:47,560::task::990::TaskManager.Task::(_decref) Task=`b38b0b00-a144-4a7b-9ec3-84af25c3bdff`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:46:47,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.828319 s, 1.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:46:49,270::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:46:50,007::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0134053 s, 37.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:46:50,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:46:55,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.40527 s, 426 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:46:55,704::task::595::TaskManager.Task::(_updateState) Task=`d35b6828-8191-4de8-8c67-6e2c05d2f667`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:46:55,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:46:55,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0134053', 'lastCheck': '5.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:46:55,705::task::1185::TaskManager.Task::(prepare) Task=`d35b6828-8191-4de8-8c67-6e2c05d2f667`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0134053', 'lastCheck': '5.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:46:55,706::task::595::TaskManager.Task::(_updateState) Task=`d35b6828-8191-4de8-8c67-6e2c05d2f667`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:46:55,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:46:55,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:46:55,707::task::990::TaskManager.Task::(_decref) Task=`d35b6828-8191-4de8-8c67-6e2c05d2f667`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:46:57,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:46:58,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Thread-26::DEBUG::2014-08-21 11:46:58,174::task::595::TaskManager.Task::(_updateState) Task=`795e4735-77b7-4fc6-b506-475b13389f2e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:46:58,175::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:46:58,175::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:46:58,175::task::1185::TaskManager.Task::(prepare) Task=`795e4735-77b7-4fc6-b506-475b13389f2e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:46:58,176::task::595::TaskManager.Task::(_updateState) Task=`795e4735-77b7-4fc6-b506-475b13389f2e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:46:58,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:46:58,176::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:46:58,176::task::990::TaskManager.Task::(_decref) Task=`795e4735-77b7-4fc6-b506-475b13389f2e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:46:58,193::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23a145ff]
>Thread-34::DEBUG::2014-08-21 11:46:58,194::task::595::TaskManager.Task::(_updateState) Task=`17478e23-c936-4eb7-9c41-591df3f23cc1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:46:58,195::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:46:58,196::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`12ce0167-d4f7-49d7-aadc-134a984630b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:46:58,196::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:46:58,198::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:46:58,199::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`12ce0167-d4f7-49d7-aadc-134a984630b8`::Granted request
>Thread-34::DEBUG::2014-08-21 11:46:58,199::task::827::TaskManager.Task::(resourceAcquired) Task=`17478e23-c936-4eb7-9c41-591df3f23cc1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:46:58,199::task::990::TaskManager.Task::(_decref) Task=`17478e23-c936-4eb7-9c41-591df3f23cc1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:46:58,205::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:58,205::task::1185::TaskManager.Task::(prepare) Task=`17478e23-c936-4eb7-9c41-591df3f23cc1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:46:58,206::task::595::TaskManager.Task::(_updateState) Task=`17478e23-c936-4eb7-9c41-591df3f23cc1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:46:58,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:46:58,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:46:58,207::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:46:58,207::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:46:58,207::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:46:58,207::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:46:58,208::task::990::TaskManager.Task::(_decref) Task=`17478e23-c936-4eb7-9c41-591df3f23cc1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:46:59,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.82228 s, 1.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:47:00,032::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:47:00,057::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000786673 s, 633 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:01,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:02,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.0124 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:04,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:04,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896757 s, 11.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:06,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:06,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.129782 s, 7.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:47:08,227::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-26::DEBUG::2014-08-21 11:47:08,228::task::595::TaskManager.Task::(_updateState) Task=`0b1ffc61-ca8d-495f-8d2e-56ca53549528`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:08,229::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:47:08,229::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:08,229::task::1185::TaskManager.Task::(prepare) Task=`0b1ffc61-ca8d-495f-8d2e-56ca53549528`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:08,230::task::595::TaskManager.Task::(_updateState) Task=`0b1ffc61-ca8d-495f-8d2e-56ca53549528`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:08,230::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:08,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:08,230::task::990::TaskManager.Task::(_decref) Task=`0b1ffc61-ca8d-495f-8d2e-56ca53549528`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:47:08,234::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-34::DEBUG::2014-08-21 11:47:08,235::task::595::TaskManager.Task::(_updateState) Task=`9c605c3d-ac30-4ea3-8505-dc96f023557e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:47:08,235::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:47:08,236::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e9bfd67c-95f4-45cf-9195-ef6e6151813b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:47:08,236::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:47:08,236::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:47:08,237::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e9bfd67c-95f4-45cf-9195-ef6e6151813b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:47:08,237::task::827::TaskManager.Task::(resourceAcquired) Task=`9c605c3d-ac30-4ea3-8505-dc96f023557e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:47:08,237::task::990::TaskManager.Task::(_decref) Task=`9c605c3d-ac30-4ea3-8505-dc96f023557e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:47:08,241::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:08,242::task::1185::TaskManager.Task::(prepare) Task=`9c605c3d-ac30-4ea3-8505-dc96f023557e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:08,242::task::595::TaskManager.Task::(_updateState) Task=`9c605c3d-ac30-4ea3-8505-dc96f023557e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:47:08,242::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:47:08,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:47:08,243::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:47:08,243::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:47:08,243::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:47:08,243::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:47:08,243::task::990::TaskManager.Task::(_decref) Task=`9c605c3d-ac30-4ea3-8505-dc96f023557e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:47:08,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:09,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.147214 s, 7.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:47:10,108::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:47:10,135::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00422798 s, 118 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:47:11,389::task::595::TaskManager.Task::(_updateState) Task=`39f0841c-99ef-456a-ba30-54ee15c939cd`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:11,390::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:47:11,390::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00422798', 'lastCheck': '1.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:47:11,390::task::1185::TaskManager.Task::(prepare) Task=`39f0841c-99ef-456a-ba30-54ee15c939cd`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00422798', 'lastCheck': '1.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:47:11,390::task::595::TaskManager.Task::(_updateState) Task=`39f0841c-99ef-456a-ba30-54ee15c939cd`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:11,391::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:11,391::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:11,391::task::990::TaskManager.Task::(_decref) Task=`39f0841c-99ef-456a-ba30-54ee15c939cd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:47:11,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:11,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0818474 s, 12.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:13,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:13,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0630421 s, 16.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:15,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:15,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552365 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:17,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:18,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415859 s, 24.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:47:18,257::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-26::DEBUG::2014-08-21 11:47:18,259::task::595::TaskManager.Task::(_updateState) Task=`cc879966-98ca-4dc0-8b5a-8f5130a53aea`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:18,259::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:47:18,260::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:18,260::task::1185::TaskManager.Task::(prepare) Task=`cc879966-98ca-4dc0-8b5a-8f5130a53aea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:18,261::task::595::TaskManager.Task::(_updateState) Task=`cc879966-98ca-4dc0-8b5a-8f5130a53aea`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:18,261::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:18,261::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:18,262::task::990::TaskManager.Task::(_decref) Task=`cc879966-98ca-4dc0-8b5a-8f5130a53aea`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:47:18,267::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-34::DEBUG::2014-08-21 11:47:18,268::task::595::TaskManager.Task::(_updateState) Task=`c0b1f9b6-c532-4cae-9a78-c6ac59a3bfb3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:47:18,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:47:18,270::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8134eece-fbbb-4312-9f61-564677bf9003`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:47:18,270::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:47:18,270::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:47:18,271::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8134eece-fbbb-4312-9f61-564677bf9003`::Granted request
>Thread-34::DEBUG::2014-08-21 11:47:18,271::task::827::TaskManager.Task::(resourceAcquired) Task=`c0b1f9b6-c532-4cae-9a78-c6ac59a3bfb3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:47:18,272::task::990::TaskManager.Task::(_decref) Task=`c0b1f9b6-c532-4cae-9a78-c6ac59a3bfb3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:47:18,277::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:18,277::task::1185::TaskManager.Task::(prepare) Task=`c0b1f9b6-c532-4cae-9a78-c6ac59a3bfb3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:18,277::task::595::TaskManager.Task::(_updateState) Task=`c0b1f9b6-c532-4cae-9a78-c6ac59a3bfb3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:47:18,277::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:47:18,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:47:18,278::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:47:18,279::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:47:18,279::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:47:18,279::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:47:18,279::task::990::TaskManager.Task::(_decref) Task=`c0b1f9b6-c532-4cae-9a78-c6ac59a3bfb3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:47:20,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:47:20,228::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:47:20,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00104468 s, 477 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:20,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0598624 s, 17.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:22,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:22,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0806836 s, 12.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:24,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:24,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0709773 s, 14.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:47:26,536::task::595::TaskManager.Task::(_updateState) Task=`d8136a66-64d3-4162-bdce-c8fba5c9cc0f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:26,537::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:47:26,537::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104468', 'lastCheck': '6.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:47:26,537::task::1185::TaskManager.Task::(prepare) Task=`d8136a66-64d3-4162-bdce-c8fba5c9cc0f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104468', 'lastCheck': '6.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:47:26,537::task::595::TaskManager.Task::(_updateState) Task=`d8136a66-64d3-4162-bdce-c8fba5c9cc0f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:26,538::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:26,538::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:26,538::task::990::TaskManager.Task::(_decref) Task=`d8136a66-64d3-4162-bdce-c8fba5c9cc0f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:47:26,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:27,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105808 s, 9.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:47:28,294::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [69bf064]
>Thread-26::DEBUG::2014-08-21 11:47:28,295::task::595::TaskManager.Task::(_updateState) Task=`eec8a6fa-585f-41f1-aaeb-f6b72e3ae75f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:28,295::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:47:28,296::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:28,296::task::1185::TaskManager.Task::(prepare) Task=`eec8a6fa-585f-41f1-aaeb-f6b72e3ae75f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:28,296::task::595::TaskManager.Task::(_updateState) Task=`eec8a6fa-585f-41f1-aaeb-f6b72e3ae75f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:28,297::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:28,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:28,297::task::990::TaskManager.Task::(_decref) Task=`eec8a6fa-585f-41f1-aaeb-f6b72e3ae75f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:47:28,302::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [69bf064]
>Thread-34::DEBUG::2014-08-21 11:47:28,303::task::595::TaskManager.Task::(_updateState) Task=`7dc2473c-fd6b-4858-8806-f5989ede98e5`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:47:28,303::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:47:28,305::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`daf1c6c4-06d6-4d45-aa52-7b59faca9e05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:47:28,305::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:47:28,306::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:47:28,306::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`daf1c6c4-06d6-4d45-aa52-7b59faca9e05`::Granted request
>Thread-34::DEBUG::2014-08-21 11:47:28,308::task::827::TaskManager.Task::(resourceAcquired) Task=`7dc2473c-fd6b-4858-8806-f5989ede98e5`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:47:28,308::task::990::TaskManager.Task::(_decref) Task=`7dc2473c-fd6b-4858-8806-f5989ede98e5`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:47:28,314::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:28,314::task::1185::TaskManager.Task::(prepare) Task=`7dc2473c-fd6b-4858-8806-f5989ede98e5`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:28,314::task::595::TaskManager.Task::(_updateState) Task=`7dc2473c-fd6b-4858-8806-f5989ede98e5`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:47:28,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:47:28,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:47:28,315::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:47:28,315::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:47:28,316::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:47:28,316::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:47:28,316::task::990::TaskManager.Task::(_decref) Task=`7dc2473c-fd6b-4858-8806-f5989ede98e5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:47:29,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:29,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0519007 s, 19.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:47:30,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:47:30,317::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0026512 s, 188 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:31,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:31,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106955 s, 9.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:33,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:33,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.192563 s, 5.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:35,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:35,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0681127 s, 15.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:37,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:38,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0632487 s, 16.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:47:38,332::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-26::DEBUG::2014-08-21 11:47:38,334::task::595::TaskManager.Task::(_updateState) Task=`8d70f181-4ba6-4cbe-8539-37c3555da7ac`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:38,335::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:47:38,335::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:38,336::task::1185::TaskManager.Task::(prepare) Task=`8d70f181-4ba6-4cbe-8539-37c3555da7ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:38,336::task::595::TaskManager.Task::(_updateState) Task=`8d70f181-4ba6-4cbe-8539-37c3555da7ac`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:38,336::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:38,336::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:38,336::task::990::TaskManager.Task::(_decref) Task=`8d70f181-4ba6-4cbe-8539-37c3555da7ac`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:47:38,344::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-34::DEBUG::2014-08-21 11:47:38,345::task::595::TaskManager.Task::(_updateState) Task=`06cc4c53-5fc9-42f7-bc6c-02270c33564b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:47:38,345::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:47:38,346::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dc474c9d-d246-4801-bbf4-5f5e76c6e952`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:47:38,346::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:47:38,347::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:47:38,347::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dc474c9d-d246-4801-bbf4-5f5e76c6e952`::Granted request
>Thread-34::DEBUG::2014-08-21 11:47:38,348::task::827::TaskManager.Task::(resourceAcquired) Task=`06cc4c53-5fc9-42f7-bc6c-02270c33564b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:47:38,348::task::990::TaskManager.Task::(_decref) Task=`06cc4c53-5fc9-42f7-bc6c-02270c33564b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:47:38,352::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:38,352::task::1185::TaskManager.Task::(prepare) Task=`06cc4c53-5fc9-42f7-bc6c-02270c33564b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:38,353::task::595::TaskManager.Task::(_updateState) Task=`06cc4c53-5fc9-42f7-bc6c-02270c33564b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:47:38,353::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:47:38,353::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:47:38,353::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:47:38,354::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:47:38,354::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:47:38,354::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:47:38,354::task::990::TaskManager.Task::(_decref) Task=`06cc4c53-5fc9-42f7-bc6c-02270c33564b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:47:42,098::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Dummy-33::DEBUG::2014-08-21 11:47:42,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:47:43,205::task::595::TaskManager.Task::(_updateState) Task=`c6bfeae2-e0da-42a6-ad29-91c9ca25f415`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:43,207::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:47:43,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0026512', 'lastCheck': '12.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:47:43,216::task::1185::TaskManager.Task::(prepare) Task=`c6bfeae2-e0da-42a6-ad29-91c9ca25f415`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0026512', 'lastCheck': '12.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:47:43,268::task::595::TaskManager.Task::(_updateState) Task=`c6bfeae2-e0da-42a6-ad29-91c9ca25f415`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:43,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:43,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:43,308::task::990::TaskManager.Task::(_decref) Task=`c6bfeae2-e0da-42a6-ad29-91c9ca25f415`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:47:43,339::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:47:43,362::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:47:43,378::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 11:47:43,391::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:47:43,394::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:47:43,396::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 11:47:43,504::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:47:43,537::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00141937 s, 351 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:43,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.15886 s, 884 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:45,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:47,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.826752 s, 1.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:47:48,373::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-26::DEBUG::2014-08-21 11:47:48,378::task::595::TaskManager.Task::(_updateState) Task=`d97083d5-ad46-4453-a540-c3f9fc4b8423`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:48,380::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:47:48,381::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:48,381::task::1185::TaskManager.Task::(prepare) Task=`d97083d5-ad46-4453-a540-c3f9fc4b8423`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:48,382::task::595::TaskManager.Task::(_updateState) Task=`d97083d5-ad46-4453-a540-c3f9fc4b8423`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:48,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:48,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:48,383::task::990::TaskManager.Task::(_decref) Task=`d97083d5-ad46-4453-a540-c3f9fc4b8423`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:47:48,388::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-34::DEBUG::2014-08-21 11:47:48,389::task::595::TaskManager.Task::(_updateState) Task=`de788b61-c4b0-490c-99aa-1ce430acb27f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:47:48,389::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:47:48,390::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6d09d533-c5a5-4e8a-8980-ee57f49d1faf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:47:48,391::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:47:48,391::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:47:48,392::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6d09d533-c5a5-4e8a-8980-ee57f49d1faf`::Granted request
>Thread-34::DEBUG::2014-08-21 11:47:48,392::task::827::TaskManager.Task::(resourceAcquired) Task=`de788b61-c4b0-490c-99aa-1ce430acb27f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:47:48,393::task::990::TaskManager.Task::(_decref) Task=`de788b61-c4b0-490c-99aa-1ce430acb27f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:47:48,399::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:48,399::task::1185::TaskManager.Task::(prepare) Task=`de788b61-c4b0-490c-99aa-1ce430acb27f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:48,400::task::595::TaskManager.Task::(_updateState) Task=`de788b61-c4b0-490c-99aa-1ce430acb27f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:47:48,400::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:47:48,400::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:47:48,401::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:47:48,401::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:47:48,401::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:47:48,402::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:47:48,402::task::990::TaskManager.Task::(_decref) Task=`de788b61-c4b0-490c-99aa-1ce430acb27f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:47:49,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:47:49,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.164743 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:51,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:47:56,845::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:47:56,983::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00194962 s, 255 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:47:57,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.18364 s, 198 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:47:58,445::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-26::DEBUG::2014-08-21 11:47:58,589::task::595::TaskManager.Task::(_updateState) Task=`bf5ca46f-7902-449e-8d2b-d502619bda55`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:58,616::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:47:58,617::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:58,618::task::1185::TaskManager.Task::(prepare) Task=`bf5ca46f-7902-449e-8d2b-d502619bda55`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:47:58,618::task::595::TaskManager.Task::(_updateState) Task=`bf5ca46f-7902-449e-8d2b-d502619bda55`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:58,619::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:58,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:58,619::task::990::TaskManager.Task::(_decref) Task=`bf5ca46f-7902-449e-8d2b-d502619bda55`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:47:58,811::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 11:47:58,833::task::595::TaskManager.Task::(_updateState) Task=`bad726c4-8e0a-4ea8-9e5b-eae858170afc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:47:58,874::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:47:59,100::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4ebce19b-536d-4650-8351-a14c55455612`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:47:59,101::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:47:59,101::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:47:59,102::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4ebce19b-536d-4650-8351-a14c55455612`::Granted request
>Thread-34::DEBUG::2014-08-21 11:47:59,180::task::827::TaskManager.Task::(resourceAcquired) Task=`bad726c4-8e0a-4ea8-9e5b-eae858170afc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:47:59,181::task::990::TaskManager.Task::(_decref) Task=`bad726c4-8e0a-4ea8-9e5b-eae858170afc`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:47:59,229::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:59,230::task::1185::TaskManager.Task::(prepare) Task=`bad726c4-8e0a-4ea8-9e5b-eae858170afc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:47:59,230::task::595::TaskManager.Task::(_updateState) Task=`bad726c4-8e0a-4ea8-9e5b-eae858170afc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:47:59,231::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:47:59,259::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:47:59,272::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Dummy-33::DEBUG::2014-08-21 11:47:59,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:47:59,302::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:47:59,310::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:47:59,313::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:47:59,315::task::990::TaskManager.Task::(_decref) Task=`bad726c4-8e0a-4ea8-9e5b-eae858170afc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:47:59,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.169915 s, 6.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:47:59,845::task::595::TaskManager.Task::(_updateState) Task=`d5e1838e-9966-4ec3-b91e-05e1ae13c9e6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:47:59,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:47:59,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00194962', 'lastCheck': '2.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:47:59,846::task::1185::TaskManager.Task::(prepare) Task=`d5e1838e-9966-4ec3-b91e-05e1ae13c9e6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00194962', 'lastCheck': '2.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:47:59,846::task::595::TaskManager.Task::(_updateState) Task=`d5e1838e-9966-4ec3-b91e-05e1ae13c9e6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:47:59,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:47:59,847::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:47:59,847::task::990::TaskManager.Task::(_decref) Task=`d5e1838e-9966-4ec3-b91e-05e1ae13c9e6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:48:01,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:01,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0623772 s, 16.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:03,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:06,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.5599 s, 656 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:48:07,124::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:48:07,151::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00125295 s, 397 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:08,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:48:09,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-13::DEBUG::2014-08-21 11:48:09,456::task::595::TaskManager.Task::(_updateState) Task=`d3f1c08d-5a68-47fa-a24a-febff5e84165`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:48:09,465::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:48:09,484::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:48:09,544::task::1185::TaskManager.Task::(prepare) Task=`d3f1c08d-5a68-47fa-a24a-febff5e84165`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:48:09,545::task::595::TaskManager.Task::(_updateState) Task=`d3f1c08d-5a68-47fa-a24a-febff5e84165`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:48:09,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:48:09,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:48:09,546::task::990::TaskManager.Task::(_decref) Task=`d3f1c08d-5a68-47fa-a24a-febff5e84165`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:48:11,407::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 11:48:11,441::task::595::TaskManager.Task::(_updateState) Task=`3d394b4e-a474-4440-b890-7ece20e66918`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:48:11,585::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:48:11,606::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b0bfd32c-aee4-4e82-901f-2a64dd119364`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:48:11,994::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:48:11,996::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:48:11,997::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b0bfd32c-aee4-4e82-901f-2a64dd119364`::Granted request
>Thread-34::DEBUG::2014-08-21 11:48:12,539::task::827::TaskManager.Task::(resourceAcquired) Task=`3d394b4e-a474-4440-b890-7ece20e66918`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:48:12,607::task::990::TaskManager.Task::(_decref) Task=`3d394b4e-a474-4440-b890-7ece20e66918`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:48:12,714::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:12,715::task::1185::TaskManager.Task::(prepare) Task=`3d394b4e-a474-4440-b890-7ece20e66918`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893835776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:12,715::task::595::TaskManager.Task::(_updateState) Task=`3d394b4e-a474-4440-b890-7ece20e66918`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:48:12,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:48:12,716::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:48:12,725::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:48:12,739::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:48:12,740::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:48:12,740::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:48:12,741::task::990::TaskManager.Task::(_decref) Task=`3d394b4e-a474-4440-b890-7ece20e66918`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:48:13,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.07835 s, 251 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:15,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:16,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.216559 s, 4.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:48:16,910::task::595::TaskManager.Task::(_updateState) Task=`93edb1c0-7cfe-4f06-9d9a-af98adf84661`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:48:16,911::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:48:16,912::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125295', 'lastCheck': '9.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:48:16,912::task::1185::TaskManager.Task::(prepare) Task=`93edb1c0-7cfe-4f06-9d9a-af98adf84661`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125295', 'lastCheck': '9.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:48:16,912::task::595::TaskManager.Task::(_updateState) Task=`93edb1c0-7cfe-4f06-9d9a-af98adf84661`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:48:16,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:48:16,913::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:48:16,913::task::990::TaskManager.Task::(_decref) Task=`93edb1c0-7cfe-4f06-9d9a-af98adf84661`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:48:17,202::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:48:17,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000425454 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:18,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:18,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.140808 s, 7.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:20,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:20,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.20686 s, 5.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:22,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:23,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.063897 s, 16.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:48:23,541::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-26::DEBUG::2014-08-21 11:48:23,542::task::595::TaskManager.Task::(_updateState) Task=`33b8cad0-6bc8-42dc-a89e-b91d87ed3b8d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:48:23,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:48:23,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:48:23,544::task::1185::TaskManager.Task::(prepare) Task=`33b8cad0-6bc8-42dc-a89e-b91d87ed3b8d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:48:23,544::task::595::TaskManager.Task::(_updateState) Task=`33b8cad0-6bc8-42dc-a89e-b91d87ed3b8d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:48:23,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:48:23,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:48:23,545::task::990::TaskManager.Task::(_decref) Task=`33b8cad0-6bc8-42dc-a89e-b91d87ed3b8d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:48:23,551::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-34::DEBUG::2014-08-21 11:48:23,552::task::595::TaskManager.Task::(_updateState) Task=`48282c74-6f60-4856-b913-b58ffa404f0d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:48:23,552::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:48:23,553::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`20ab3519-61f4-489c-9dcc-e7afde422001`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:48:23,553::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:48:23,554::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:48:23,554::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`20ab3519-61f4-489c-9dcc-e7afde422001`::Granted request
>Thread-34::DEBUG::2014-08-21 11:48:23,555::task::827::TaskManager.Task::(resourceAcquired) Task=`48282c74-6f60-4856-b913-b58ffa404f0d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:48:23,556::task::990::TaskManager.Task::(_decref) Task=`48282c74-6f60-4856-b913-b58ffa404f0d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:48:23,562::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893639168', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:23,563::task::1185::TaskManager.Task::(prepare) Task=`48282c74-6f60-4856-b913-b58ffa404f0d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893639168', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:23,563::task::595::TaskManager.Task::(_updateState) Task=`48282c74-6f60-4856-b913-b58ffa404f0d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:48:23,563::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:48:23,563::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:48:23,564::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:48:23,564::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:48:23,565::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:48:23,565::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:48:23,565::task::990::TaskManager.Task::(_decref) Task=`48282c74-6f60-4856-b913-b58ffa404f0d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:48:25,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:25,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0660248 s, 15.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:27,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:48:27,331::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:48:29,354::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0173951 s, 28.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:29,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.62563 s, 390 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:31,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:32,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0593603 s, 17.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:48:32,716::task::595::TaskManager.Task::(_updateState) Task=`07aa56c8-4b1c-4019-8180-c1cbbb725727`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:48:32,717::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:48:32,717::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0173951', 'lastCheck': '3.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:48:32,717::task::1185::TaskManager.Task::(prepare) Task=`07aa56c8-4b1c-4019-8180-c1cbbb725727`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0173951', 'lastCheck': '3.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:48:32,717::task::595::TaskManager.Task::(_updateState) Task=`07aa56c8-4b1c-4019-8180-c1cbbb725727`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:48:32,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:48:32,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:48:32,720::task::990::TaskManager.Task::(_decref) Task=`07aa56c8-4b1c-4019-8180-c1cbbb725727`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 11:48:33,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-26::DEBUG::2014-08-21 11:48:33,582::task::595::TaskManager.Task::(_updateState) Task=`52124ab6-71a6-493d-ada2-f5ea33c48dbd`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:48:33,582::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:48:33,583::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:48:33,583::task::1185::TaskManager.Task::(prepare) Task=`52124ab6-71a6-493d-ada2-f5ea33c48dbd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:48:33,583::task::595::TaskManager.Task::(_updateState) Task=`52124ab6-71a6-493d-ada2-f5ea33c48dbd`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:48:33,584::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:48:33,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:48:33,584::task::990::TaskManager.Task::(_decref) Task=`52124ab6-71a6-493d-ada2-f5ea33c48dbd`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:48:33,589::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 11:48:33,590::task::595::TaskManager.Task::(_updateState) Task=`b2905fc0-e118-46fd-b274-5f32e98ab2a6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:48:33,591::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:48:33,591::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2a4b2e72-8f4b-4f57-8a83-ab5e2d6d88e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:48:33,591::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:48:33,592::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:48:33,592::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2a4b2e72-8f4b-4f57-8a83-ab5e2d6d88e5`::Granted request
>Thread-34::DEBUG::2014-08-21 11:48:33,592::task::827::TaskManager.Task::(resourceAcquired) Task=`b2905fc0-e118-46fd-b274-5f32e98ab2a6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:48:33,592::task::990::TaskManager.Task::(_decref) Task=`b2905fc0-e118-46fd-b274-5f32e98ab2a6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:48:33,599::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:33,599::task::1185::TaskManager.Task::(prepare) Task=`b2905fc0-e118-46fd-b274-5f32e98ab2a6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:33,600::task::595::TaskManager.Task::(_updateState) Task=`b2905fc0-e118-46fd-b274-5f32e98ab2a6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:48:33,600::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:48:33,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:48:33,601::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:48:33,601::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:48:33,601::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:48:33,601::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:48:33,602::task::990::TaskManager.Task::(_decref) Task=`b2905fc0-e118-46fd-b274-5f32e98ab2a6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:48:34,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:34,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.413318 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:36,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:37,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107686 s, 9.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:39,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:39,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0654059 s, 15.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:48:39,842::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:48:39,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0117219 s, 42.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:41,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:41,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0693697 s, 14.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:43,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:43,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0825346 s, 12.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:48:43,621::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-26::DEBUG::2014-08-21 11:48:43,623::task::595::TaskManager.Task::(_updateState) Task=`2cda78a4-1b3a-41ba-b512-806665faa762`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:48:43,623::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:48:43,624::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:48:43,624::task::1185::TaskManager.Task::(prepare) Task=`2cda78a4-1b3a-41ba-b512-806665faa762`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:48:43,625::task::595::TaskManager.Task::(_updateState) Task=`2cda78a4-1b3a-41ba-b512-806665faa762`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:48:43,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:48:43,625::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:48:43,625::task::990::TaskManager.Task::(_decref) Task=`2cda78a4-1b3a-41ba-b512-806665faa762`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:48:43,630::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 11:48:43,630::task::595::TaskManager.Task::(_updateState) Task=`8048741f-f871-49d8-ba51-c5c0134c7dcf`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:48:43,631::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:48:43,634::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`84a75b67-3390-4ca6-a93e-ddca4f9d3e6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:48:43,634::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:48:43,635::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:48:43,635::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`84a75b67-3390-4ca6-a93e-ddca4f9d3e6f`::Granted request
>Thread-34::DEBUG::2014-08-21 11:48:43,636::task::827::TaskManager.Task::(resourceAcquired) Task=`8048741f-f871-49d8-ba51-c5c0134c7dcf`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:48:43,636::task::990::TaskManager.Task::(_decref) Task=`8048741f-f871-49d8-ba51-c5c0134c7dcf`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:48:43,645::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:43,646::task::1185::TaskManager.Task::(prepare) Task=`8048741f-f871-49d8-ba51-c5c0134c7dcf`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:43,646::task::595::TaskManager.Task::(_updateState) Task=`8048741f-f871-49d8-ba51-c5c0134c7dcf`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:48:43,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:48:43,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:48:43,647::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:48:43,648::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:48:43,648::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:48:43,648::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:48:43,649::task::990::TaskManager.Task::(_decref) Task=`8048741f-f871-49d8-ba51-c5c0134c7dcf`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:48:45,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:46,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.328115 s, 3.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:48:47,865::task::595::TaskManager.Task::(_updateState) Task=`9df92ae7-e567-4038-ac70-5db25b7be6b0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:48:47,866::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:48:47,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117219', 'lastCheck': '7.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:48:47,867::task::1185::TaskManager.Task::(prepare) Task=`9df92ae7-e567-4038-ac70-5db25b7be6b0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117219', 'lastCheck': '7.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:48:47,867::task::595::TaskManager.Task::(_updateState) Task=`9df92ae7-e567-4038-ac70-5db25b7be6b0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:48:47,867::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:48:47,868::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:48:47,868::task::990::TaskManager.Task::(_decref) Task=`9df92ae7-e567-4038-ac70-5db25b7be6b0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:48:48,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:48,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0745195 s, 13.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:48:49,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:48:49,962::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000440798 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:50,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:50,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0994618 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:52,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:52,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0722438 s, 14.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:48:53,663::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-26::DEBUG::2014-08-21 11:48:53,666::task::595::TaskManager.Task::(_updateState) Task=`cba72937-249c-48f0-9bbc-c7b026930765`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:48:53,667::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:48:53,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:48:53,668::task::1185::TaskManager.Task::(prepare) Task=`cba72937-249c-48f0-9bbc-c7b026930765`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:48:53,668::task::595::TaskManager.Task::(_updateState) Task=`cba72937-249c-48f0-9bbc-c7b026930765`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:48:53,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:48:53,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:48:53,669::task::990::TaskManager.Task::(_decref) Task=`cba72937-249c-48f0-9bbc-c7b026930765`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:48:53,676::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-34::DEBUG::2014-08-21 11:48:53,678::task::595::TaskManager.Task::(_updateState) Task=`8f31fc53-75b7-468b-ab05-dc24b7d40880`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:48:53,678::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:48:53,679::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`522261b4-7d8a-4428-93df-6684ce6c65be`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:48:53,679::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:48:53,680::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:48:53,680::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`522261b4-7d8a-4428-93df-6684ce6c65be`::Granted request
>Thread-34::DEBUG::2014-08-21 11:48:53,681::task::827::TaskManager.Task::(resourceAcquired) Task=`8f31fc53-75b7-468b-ab05-dc24b7d40880`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:48:53,681::task::990::TaskManager.Task::(_decref) Task=`8f31fc53-75b7-468b-ab05-dc24b7d40880`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:48:53,690::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:53,690::task::1185::TaskManager.Task::(prepare) Task=`8f31fc53-75b7-468b-ab05-dc24b7d40880`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:48:53,691::task::595::TaskManager.Task::(_updateState) Task=`8f31fc53-75b7-468b-ab05-dc24b7d40880`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:48:53,691::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:48:53,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:48:53,692::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:48:53,693::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:48:53,693::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:48:53,693::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:48:53,694::task::990::TaskManager.Task::(_decref) Task=`8f31fc53-75b7-468b-ab05-dc24b7d40880`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:48:54,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:55,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0730658 s, 14.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:57,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:57,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0852215 s, 12.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:48:59,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:48:59,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0906917 s, 11.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:49:00,010::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:49:00,137::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00245236 s, 203 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:01,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:49:03,187::task::595::TaskManager.Task::(_updateState) Task=`acf01699-6d92-4dcd-b67b-985964aa1b3b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:49:03,188::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:49:03,189::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00245236', 'lastCheck': '2.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:49:03,190::task::1185::TaskManager.Task::(prepare) Task=`acf01699-6d92-4dcd-b67b-985964aa1b3b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00245236', 'lastCheck': '2.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:49:03,191::task::595::TaskManager.Task::(_updateState) Task=`acf01699-6d92-4dcd-b67b-985964aa1b3b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:49:03,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:49:03,200::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:49:03,210::task::990::TaskManager.Task::(_decref) Task=`acf01699-6d92-4dcd-b67b-985964aa1b3b`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:49:03,757::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-13::DEBUG::2014-08-21 11:49:03,758::task::595::TaskManager.Task::(_updateState) Task=`86c1b72b-95d5-4603-b382-e6ca5b1e8637`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:49:03,758::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:49:03,759::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:03,760::task::1185::TaskManager.Task::(prepare) Task=`86c1b72b-95d5-4603-b382-e6ca5b1e8637`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:03,760::task::595::TaskManager.Task::(_updateState) Task=`86c1b72b-95d5-4603-b382-e6ca5b1e8637`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:49:03,760::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:49:03,760::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:49:03,761::task::990::TaskManager.Task::(_decref) Task=`86c1b72b-95d5-4603-b382-e6ca5b1e8637`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:49:04,242::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 11:49:04,256::task::595::TaskManager.Task::(_updateState) Task=`596a84de-e1e2-49da-9320-d662e20a1012`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:49:04,257::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:49:04,263::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a85d6283-4349-465e-a29c-75cf4bdbd67e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:49:04,263::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:49:04,265::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:49:04,266::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a85d6283-4349-465e-a29c-75cf4bdbd67e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:49:04,267::task::827::TaskManager.Task::(resourceAcquired) Task=`596a84de-e1e2-49da-9320-d662e20a1012`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:49:04,268::task::990::TaskManager.Task::(_decref) Task=`596a84de-e1e2-49da-9320-d662e20a1012`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:49:04,275::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:04,276::task::1185::TaskManager.Task::(prepare) Task=`596a84de-e1e2-49da-9320-d662e20a1012`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:04,277::task::595::TaskManager.Task::(_updateState) Task=`596a84de-e1e2-49da-9320-d662e20a1012`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:49:04,277::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:49:04,277::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:49:04,290::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:49:04,292::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:49:04,292::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:49:04,293::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:49:04,293::task::990::TaskManager.Task::(_decref) Task=`596a84de-e1e2-49da-9320-d662e20a1012`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:49:04,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.61868 s, 633 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:06,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:06,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119367 s, 8.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:08,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:10,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.37535 s, 745 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:49:10,611::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:49:10,630::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000500075 s, 996 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:12,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:13,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.210157 s, 4.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:49:14,319::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-13::DEBUG::2014-08-21 11:49:14,322::task::595::TaskManager.Task::(_updateState) Task=`e459d6f1-bd49-4e16-a382-a42a18cbd8c5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:49:14,323::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:49:14,324::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:14,324::task::1185::TaskManager.Task::(prepare) Task=`e459d6f1-bd49-4e16-a382-a42a18cbd8c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:14,324::task::595::TaskManager.Task::(_updateState) Task=`e459d6f1-bd49-4e16-a382-a42a18cbd8c5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:49:14,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:49:14,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:49:14,326::task::990::TaskManager.Task::(_decref) Task=`e459d6f1-bd49-4e16-a382-a42a18cbd8c5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:49:14,347::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 11:49:14,347::task::595::TaskManager.Task::(_updateState) Task=`1f60e021-0f79-467f-a93e-c7cc0dcaa9ba`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:49:14,348::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:49:14,349::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aa4d4bff-0326-4b58-8e0c-b0bcbefb0f7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:49:14,349::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:49:14,349::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:49:14,350::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aa4d4bff-0326-4b58-8e0c-b0bcbefb0f7b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:49:14,350::task::827::TaskManager.Task::(resourceAcquired) Task=`1f60e021-0f79-467f-a93e-c7cc0dcaa9ba`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:49:14,350::task::990::TaskManager.Task::(_decref) Task=`1f60e021-0f79-467f-a93e-c7cc0dcaa9ba`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:49:14,354::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:14,354::task::1185::TaskManager.Task::(prepare) Task=`1f60e021-0f79-467f-a93e-c7cc0dcaa9ba`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:14,355::task::595::TaskManager.Task::(_updateState) Task=`1f60e021-0f79-467f-a93e-c7cc0dcaa9ba`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:49:14,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:49:14,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:49:14,355::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:49:14,356::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:49:14,356::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:49:14,356::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:49:14,356::task::990::TaskManager.Task::(_decref) Task=`1f60e021-0f79-467f-a93e-c7cc0dcaa9ba`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:49:15,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:15,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0812918 s, 12.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:17,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:49:22,398::task::595::TaskManager.Task::(_updateState) Task=`3786d9d4-32ae-4e16-94ae-e25611406d93`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:49:22,440::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:49:22,445::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500075', 'lastCheck': '11.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:49:22,459::task::1185::TaskManager.Task::(prepare) Task=`3786d9d4-32ae-4e16-94ae-e25611406d93`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500075', 'lastCheck': '11.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:49:22,499::task::595::TaskManager.Task::(_updateState) Task=`3786d9d4-32ae-4e16-94ae-e25611406d93`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:49:22,557::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:49:22,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:49:22,595::task::990::TaskManager.Task::(_decref) Task=`3786d9d4-32ae-4e16-94ae-e25611406d93`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:49:22,820::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:49:22,910::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.010401 s, 47.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:23,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.03962 s, 170 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:49:24,389::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-13::DEBUG::2014-08-21 11:49:24,390::task::595::TaskManager.Task::(_updateState) Task=`d9d86af7-b67c-495d-bca9-f211fd57f57a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:49:24,391::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:49:24,392::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:24,392::task::1185::TaskManager.Task::(prepare) Task=`d9d86af7-b67c-495d-bca9-f211fd57f57a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:24,393::task::595::TaskManager.Task::(_updateState) Task=`d9d86af7-b67c-495d-bca9-f211fd57f57a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:49:24,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:49:24,429::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:49:24,430::task::990::TaskManager.Task::(_decref) Task=`d9d86af7-b67c-495d-bca9-f211fd57f57a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:49:24,442::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-34::DEBUG::2014-08-21 11:49:24,445::task::595::TaskManager.Task::(_updateState) Task=`a8667b70-06e8-4280-8224-f8c3b0896ce1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:49:24,446::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:49:24,447::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`32269812-1bea-4ac8-94f2-2aeb3bae4713`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:49:24,447::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:49:24,448::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:49:24,448::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`32269812-1bea-4ac8-94f2-2aeb3bae4713`::Granted request
>Thread-34::DEBUG::2014-08-21 11:49:24,449::task::827::TaskManager.Task::(resourceAcquired) Task=`a8667b70-06e8-4280-8224-f8c3b0896ce1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:49:24,450::task::990::TaskManager.Task::(_decref) Task=`a8667b70-06e8-4280-8224-f8c3b0896ce1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:49:24,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:24,467::task::1185::TaskManager.Task::(prepare) Task=`a8667b70-06e8-4280-8224-f8c3b0896ce1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:24,468::task::595::TaskManager.Task::(_updateState) Task=`a8667b70-06e8-4280-8224-f8c3b0896ce1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:49:24,482::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:49:24,482::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:49:24,483::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:49:24,483::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:49:24,483::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:49:24,484::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:49:24,484::task::990::TaskManager.Task::(_decref) Task=`a8667b70-06e8-4280-8224-f8c3b0896ce1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:49:25,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:27,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.797558 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:29,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:29,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505204 s, 20.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:31,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:32,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.277665 s, 3.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:49:33,040::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:49:33,059::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000692028 s, 720 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:34,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:34,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.114257 s, 9.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:49:34,517::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-13::DEBUG::2014-08-21 11:49:34,519::task::595::TaskManager.Task::(_updateState) Task=`87c61ead-7a9b-470f-90eb-52d5d64434f2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:49:34,519::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:49:34,521::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:34,521::task::1185::TaskManager.Task::(prepare) Task=`87c61ead-7a9b-470f-90eb-52d5d64434f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:34,522::task::595::TaskManager.Task::(_updateState) Task=`87c61ead-7a9b-470f-90eb-52d5d64434f2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:49:34,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:49:34,522::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:49:34,523::task::990::TaskManager.Task::(_decref) Task=`87c61ead-7a9b-470f-90eb-52d5d64434f2`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:49:34,528::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 11:49:34,529::task::595::TaskManager.Task::(_updateState) Task=`d2573cf9-f9e3-447d-99eb-79e1efd2db57`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:49:34,530::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:49:34,531::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6675f4f5-4392-4d26-9338-7100fb7d8c1f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:49:34,532::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:49:34,532::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:49:34,532::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6675f4f5-4392-4d26-9338-7100fb7d8c1f`::Granted request
>Thread-34::DEBUG::2014-08-21 11:49:34,533::task::827::TaskManager.Task::(resourceAcquired) Task=`d2573cf9-f9e3-447d-99eb-79e1efd2db57`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:49:34,533::task::990::TaskManager.Task::(_decref) Task=`d2573cf9-f9e3-447d-99eb-79e1efd2db57`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:49:34,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:34,540::task::1185::TaskManager.Task::(prepare) Task=`d2573cf9-f9e3-447d-99eb-79e1efd2db57`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:34,541::task::595::TaskManager.Task::(_updateState) Task=`d2573cf9-f9e3-447d-99eb-79e1efd2db57`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:49:34,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:49:34,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:49:34,542::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:49:34,542::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:49:34,542::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:49:34,543::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:49:34,543::task::990::TaskManager.Task::(_decref) Task=`d2573cf9-f9e3-447d-99eb-79e1efd2db57`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:49:36,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:36,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.108375 s, 9.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:38,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:38,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0763491 s, 13.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:49:38,911::task::595::TaskManager.Task::(_updateState) Task=`53489746-a880-4f42-807e-7183e06e00fc`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:49:38,912::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:49:38,912::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692028', 'lastCheck': '5.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:49:38,912::task::1185::TaskManager.Task::(prepare) Task=`53489746-a880-4f42-807e-7183e06e00fc`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692028', 'lastCheck': '5.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:49:38,913::task::595::TaskManager.Task::(_updateState) Task=`53489746-a880-4f42-807e-7183e06e00fc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:49:38,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:49:38,913::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:49:38,913::task::990::TaskManager.Task::(_decref) Task=`53489746-a880-4f42-807e-7183e06e00fc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:49:40,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:41,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0834753 s, 12.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:49:43,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:49:43,097::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000989301 s, 503 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:43,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:43,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554132 s, 18.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:49:44,569::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-13::DEBUG::2014-08-21 11:49:44,570::task::595::TaskManager.Task::(_updateState) Task=`0426fcae-22df-46c0-a572-50b3e132b4b5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:49:44,571::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:49:44,571::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:44,571::task::1185::TaskManager.Task::(prepare) Task=`0426fcae-22df-46c0-a572-50b3e132b4b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:44,572::task::595::TaskManager.Task::(_updateState) Task=`0426fcae-22df-46c0-a572-50b3e132b4b5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:49:44,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:49:44,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:49:44,572::task::990::TaskManager.Task::(_decref) Task=`0426fcae-22df-46c0-a572-50b3e132b4b5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:49:44,576::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 11:49:44,577::task::595::TaskManager.Task::(_updateState) Task=`951addae-13f8-4185-bb23-bd7eacfbb321`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:49:44,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:49:44,577::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`93bcbdb9-bb13-4a3a-be65-003e65b065d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:49:44,578::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:49:44,578::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:49:44,578::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`93bcbdb9-bb13-4a3a-be65-003e65b065d0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:49:44,579::task::827::TaskManager.Task::(resourceAcquired) Task=`951addae-13f8-4185-bb23-bd7eacfbb321`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:49:44,579::task::990::TaskManager.Task::(_decref) Task=`951addae-13f8-4185-bb23-bd7eacfbb321`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:49:44,582::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:44,582::task::1185::TaskManager.Task::(prepare) Task=`951addae-13f8-4185-bb23-bd7eacfbb321`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:44,582::task::595::TaskManager.Task::(_updateState) Task=`951addae-13f8-4185-bb23-bd7eacfbb321`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:49:44,583::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:49:44,583::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:49:44,583::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:49:44,583::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:49:44,583::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:49:44,584::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:49:44,584::task::990::TaskManager.Task::(_decref) Task=`951addae-13f8-4185-bb23-bd7eacfbb321`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:49:45,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:45,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0934516 s, 11.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:47,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:48,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.575088 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:50,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:50,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0765942 s, 13.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:52,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:49:55,927::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-26::DEBUG::2014-08-21 11:49:55,934::task::595::TaskManager.Task::(_updateState) Task=`e255bb11-9b63-43be-b04a-77f1989e1318`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:49:55,936::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:49:55,939::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:49:55,940::task::595::TaskManager.Task::(_updateState) Task=`ebbd41d3-9d3c-4228-82d8-bb22b91ee09e`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 11:49:55,940::task::1185::TaskManager.Task::(prepare) Task=`e255bb11-9b63-43be-b04a-77f1989e1318`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:49:55,942::task::595::TaskManager.Task::(_updateState) Task=`e255bb11-9b63-43be-b04a-77f1989e1318`::moving from state preparing -> state finished
>Thread-13::INFO::2014-08-21 11:49:55,942::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::DEBUG::2014-08-21 11:49:55,943::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:49:55,945::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:49:55,947::task::990::TaskManager.Task::(_decref) Task=`e255bb11-9b63-43be-b04a-77f1989e1318`::ref 0 aborting False
>Thread-13::INFO::2014-08-21 11:49:55,946::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000989301', 'lastCheck': '12.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:49:55,948::task::1185::TaskManager.Task::(prepare) Task=`ebbd41d3-9d3c-4228-82d8-bb22b91ee09e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000989301', 'lastCheck': '12.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:49:55,949::task::595::TaskManager.Task::(_updateState) Task=`ebbd41d3-9d3c-4228-82d8-bb22b91ee09e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:49:55,950::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:49:55,950::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:49:55,951::task::990::TaskManager.Task::(_decref) Task=`ebbd41d3-9d3c-4228-82d8-bb22b91ee09e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:49:56,005::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 11:49:56,006::task::595::TaskManager.Task::(_updateState) Task=`e0109270-a61a-4d93-acea-52ac1a543843`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:49:56,006::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:49:56,007::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`79ae4ab5-be1c-4042-b0eb-3aeec56173f7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:49:56,007::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:49:56,008::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:49:56,008::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`79ae4ab5-be1c-4042-b0eb-3aeec56173f7`::Granted request
>Thread-34::DEBUG::2014-08-21 11:49:56,009::task::827::TaskManager.Task::(resourceAcquired) Task=`e0109270-a61a-4d93-acea-52ac1a543843`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:49:56,009::task::990::TaskManager.Task::(_decref) Task=`e0109270-a61a-4d93-acea-52ac1a543843`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:49:56,015::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:56,017::task::1185::TaskManager.Task::(prepare) Task=`e0109270-a61a-4d93-acea-52ac1a543843`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:49:56,017::task::595::TaskManager.Task::(_updateState) Task=`e0109270-a61a-4d93-acea-52ac1a543843`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:49:56,018::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:49:56,018::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:49:56,028::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:49:56,035::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:49:56,035::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:49:56,036::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:49:56,036::task::990::TaskManager.Task::(_decref) Task=`e0109270-a61a-4d93-acea-52ac1a543843`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:49:56,141::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:49:56,175::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000531467 s, 937 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:56,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.65808 s, 280 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:49:58,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:49:58,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.207771 s, 4.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:00,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:50:09,254::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-26::DEBUG::2014-08-21 11:50:09,257::task::595::TaskManager.Task::(_updateState) Task=`3738fac5-dc2b-47b4-9387-2b84d9fa4839`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:50:09,258::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:50:09,261::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:50:09,261::task::1185::TaskManager.Task::(prepare) Task=`3738fac5-dc2b-47b4-9387-2b84d9fa4839`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:50:09,262::task::595::TaskManager.Task::(_updateState) Task=`3738fac5-dc2b-47b4-9387-2b84d9fa4839`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:50:09,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:50:09,263::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:50:09,264::task::990::TaskManager.Task::(_decref) Task=`3738fac5-dc2b-47b4-9387-2b84d9fa4839`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:50:09,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-34::DEBUG::2014-08-21 11:50:09,368::task::595::TaskManager.Task::(_updateState) Task=`5a6e5e50-62c3-4606-b012-a833be93152b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:50:09,369::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:50:09,370::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`08d89136-7f0b-405b-b744-4453301816cc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:50:09,371::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:50:09,373::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:50:09,374::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`08d89136-7f0b-405b-b744-4453301816cc`::Granted request
>Thread-34::DEBUG::2014-08-21 11:50:09,381::task::827::TaskManager.Task::(resourceAcquired) Task=`5a6e5e50-62c3-4606-b012-a833be93152b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:50:09,383::task::990::TaskManager.Task::(_decref) Task=`5a6e5e50-62c3-4606-b012-a833be93152b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:50:09,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:50:09,404::task::1185::TaskManager.Task::(prepare) Task=`5a6e5e50-62c3-4606-b012-a833be93152b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893704704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:50:09,405::task::595::TaskManager.Task::(_updateState) Task=`5a6e5e50-62c3-4606-b012-a833be93152b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:50:09,405::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:50:09,406::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 11:50:09,825::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:09,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.43035 s, 121 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:50:10,581::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:50:14,016::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:50:14,037::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:50:14,047::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:50:14,061::task::990::TaskManager.Task::(_decref) Task=`5a6e5e50-62c3-4606-b012-a833be93152b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:50:14,100::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00297474 s, 167 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:16,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:17,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.10652 s, 925 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:19,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:19,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0738829 s, 13.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:50:20,210::task::595::TaskManager.Task::(_updateState) Task=`e6d46c82-1fa1-4304-8bbb-a08cb66bb51b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:50:20,211::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:50:20,211::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00297474', 'lastCheck': '6.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:50:20,211::task::1185::TaskManager.Task::(prepare) Task=`e6d46c82-1fa1-4304-8bbb-a08cb66bb51b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00297474', 'lastCheck': '6.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:50:20,211::task::595::TaskManager.Task::(_updateState) Task=`e6d46c82-1fa1-4304-8bbb-a08cb66bb51b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:50:20,212::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:50:20,212::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:50:20,212::task::990::TaskManager.Task::(_decref) Task=`e6d46c82-1fa1-4304-8bbb-a08cb66bb51b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:50:21,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:22,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.366257 s, 2.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:50:24,123::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-26::DEBUG::2014-08-21 11:50:24,126::task::595::TaskManager.Task::(_updateState) Task=`2bdb84b9-490e-489d-a064-c3dd08500d64`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:50:24,317::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:50:24,318::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:50:24,318::task::1185::TaskManager.Task::(prepare) Task=`2bdb84b9-490e-489d-a064-c3dd08500d64`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:50:24,319::task::595::TaskManager.Task::(_updateState) Task=`2bdb84b9-490e-489d-a064-c3dd08500d64`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:50:24,319::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:50:24,319::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:50:24,320::task::990::TaskManager.Task::(_decref) Task=`2bdb84b9-490e-489d-a064-c3dd08500d64`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:50:24,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:50:24,691::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:50:24,987::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-34::DEBUG::2014-08-21 11:50:25,021::task::595::TaskManager.Task::(_updateState) Task=`b54ca1bf-3335-4603-bbf7-3a16db4242c2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:50:25,092::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:50:25,108::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`888a99a8-7bd2-4b54-9f47-6e3fe08f6572`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:50:25,111::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 11:50:25,116::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00470607 s, 106 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:50:25,194::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:50:25,207::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`888a99a8-7bd2-4b54-9f47-6e3fe08f6572`::Granted request
>Thread-34::DEBUG::2014-08-21 11:50:25,294::task::827::TaskManager.Task::(resourceAcquired) Task=`b54ca1bf-3335-4603-bbf7-3a16db4242c2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:50:25,299::task::990::TaskManager.Task::(_decref) Task=`b54ca1bf-3335-4603-bbf7-3a16db4242c2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:50:25,434::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:50:25,436::task::1185::TaskManager.Task::(prepare) Task=`b54ca1bf-3335-4603-bbf7-3a16db4242c2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:50:25,439::task::595::TaskManager.Task::(_updateState) Task=`b54ca1bf-3335-4603-bbf7-3a16db4242c2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:50:25,444::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:50:25,450::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:50:25,457::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:50:25,459::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:50:25,461::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:50:25,466::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:50:25,467::task::990::TaskManager.Task::(_decref) Task=`b54ca1bf-3335-4603-bbf7-3a16db4242c2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:50:25,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.989545 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:27,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:27,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0948054 s, 10.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:29,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:31,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.10509 s, 927 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:34,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:50:37,446::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-26::DEBUG::2014-08-21 11:50:38,503::task::595::TaskManager.Task::(_updateState) Task=`9803d475-41fe-4435-9fe2-0d5697c02702`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:50:39,482::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::DEBUG::2014-08-21 11:50:39,687::task::595::TaskManager.Task::(_updateState) Task=`3e83677d-295f-4421-a6ae-21f218325321`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:50:41,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:50:41,059::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00470607', 'lastCheck': '15.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:50:41,060::task::1185::TaskManager.Task::(prepare) Task=`3e83677d-295f-4421-a6ae-21f218325321`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00470607', 'lastCheck': '15.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:50:41,060::task::595::TaskManager.Task::(_updateState) Task=`3e83677d-295f-4421-a6ae-21f218325321`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:50:41,061::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-15::DEBUG::2014-08-21 11:50:41,484::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::INFO::2014-08-21 11:50:41,548::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:50:41,553::task::1185::TaskManager.Task::(prepare) Task=`9803d475-41fe-4435-9fe2-0d5697c02702`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:50:41,555::task::595::TaskManager.Task::(_updateState) Task=`9803d475-41fe-4435-9fe2-0d5697c02702`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:50:41,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:50:41,556::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:50:41,557::task::990::TaskManager.Task::(_decref) Task=`9803d475-41fe-4435-9fe2-0d5697c02702`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:50:41,690::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:50:41,711::task::990::TaskManager.Task::(_decref) Task=`3e83677d-295f-4421-a6ae-21f218325321`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:50:42,411::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0393504 s, 12.7 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:50:42,765::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-34::DEBUG::2014-08-21 11:50:42,875::task::595::TaskManager.Task::(_updateState) Task=`2583415f-9d60-4fca-9836-10bf28fadcc6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:50:42,980::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:50:43,057::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac981e88-4ea9-4cda-a417-d81b844f0fa9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:50:43,068::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:50:43,102::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:50:43,103::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac981e88-4ea9-4cda-a417-d81b844f0fa9`::Granted request
>Thread-34::DEBUG::2014-08-21 11:50:43,136::task::827::TaskManager.Task::(resourceAcquired) Task=`2583415f-9d60-4fca-9836-10bf28fadcc6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:50:43,138::task::990::TaskManager.Task::(_decref) Task=`2583415f-9d60-4fca-9836-10bf28fadcc6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:50:43,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:50:43,434::task::1185::TaskManager.Task::(prepare) Task=`2583415f-9d60-4fca-9836-10bf28fadcc6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:50:43,434::task::595::TaskManager.Task::(_updateState) Task=`2583415f-9d60-4fca-9836-10bf28fadcc6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:50:43,435::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:50:43,435::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:50:43,553::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:50:43,561::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:50:43,565::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:50:43,567::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:50:43,571::task::990::TaskManager.Task::(_decref) Task=`2583415f-9d60-4fca-9836-10bf28fadcc6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:50:43,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.186356 s, 5.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:45,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:45,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0694246 s, 14.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:47,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:48,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0740006 s, 13.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:50,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:50,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0876372 s, 11.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:52,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:52,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0498222 s, 20.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:50:52,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:50:52,830::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00228995 s, 217 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:50:53,610::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-13::DEBUG::2014-08-21 11:50:53,613::task::595::TaskManager.Task::(_updateState) Task=`d683e482-af87-45d4-96c7-c59c852e3896`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:50:53,613::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:50:53,614::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:50:53,614::task::1185::TaskManager.Task::(prepare) Task=`d683e482-af87-45d4-96c7-c59c852e3896`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:50:53,614::task::595::TaskManager.Task::(_updateState) Task=`d683e482-af87-45d4-96c7-c59c852e3896`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:50:53,614::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:50:53,614::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:50:53,615::task::990::TaskManager.Task::(_decref) Task=`d683e482-af87-45d4-96c7-c59c852e3896`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:50:53,619::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-34::DEBUG::2014-08-21 11:50:53,620::task::595::TaskManager.Task::(_updateState) Task=`fa2e788a-f5a9-4a3a-ad72-10fea7fa02bf`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:50:53,620::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:50:53,621::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`00be7f58-907d-44f5-9a6c-372eecbaeb5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:50:53,621::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:50:53,621::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:50:53,621::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`00be7f58-907d-44f5-9a6c-372eecbaeb5e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:50:53,622::task::827::TaskManager.Task::(resourceAcquired) Task=`fa2e788a-f5a9-4a3a-ad72-10fea7fa02bf`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:50:53,622::task::990::TaskManager.Task::(_decref) Task=`fa2e788a-f5a9-4a3a-ad72-10fea7fa02bf`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:50:53,625::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:50:53,626::task::1185::TaskManager.Task::(prepare) Task=`fa2e788a-f5a9-4a3a-ad72-10fea7fa02bf`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:50:53,626::task::595::TaskManager.Task::(_updateState) Task=`fa2e788a-f5a9-4a3a-ad72-10fea7fa02bf`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:50:53,626::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:50:53,626::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:50:53,627::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:50:53,627::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:50:53,627::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:50:53,627::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:50:53,627::task::990::TaskManager.Task::(_decref) Task=`fa2e788a-f5a9-4a3a-ad72-10fea7fa02bf`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:50:54,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:54,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0838067 s, 12.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:50:56,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:57,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.148697 s, 6.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:50:58,212::task::595::TaskManager.Task::(_updateState) Task=`5bdf5249-4cfc-4811-8c7f-150e4377924c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:50:58,213::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:50:58,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00228995', 'lastCheck': '5.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:50:58,213::task::1185::TaskManager.Task::(prepare) Task=`5bdf5249-4cfc-4811-8c7f-150e4377924c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00228995', 'lastCheck': '5.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:50:58,214::task::595::TaskManager.Task::(_updateState) Task=`5bdf5249-4cfc-4811-8c7f-150e4377924c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:50:58,214::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:50:58,214::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:50:58,215::task::990::TaskManager.Task::(_decref) Task=`5bdf5249-4cfc-4811-8c7f-150e4377924c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:50:59,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:50:59,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0837164 s, 12.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:01,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:51:03,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:51:03,892::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-13::DEBUG::2014-08-21 11:51:03,896::task::595::TaskManager.Task::(_updateState) Task=`4b6ce97f-e885-4b8a-b447-48ed68354b5e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:51:03,932::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:51:03,933::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:51:03,933::task::1185::TaskManager.Task::(prepare) Task=`4b6ce97f-e885-4b8a-b447-48ed68354b5e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:51:03,934::task::595::TaskManager.Task::(_updateState) Task=`4b6ce97f-e885-4b8a-b447-48ed68354b5e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:51:03,934::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:51:03,935::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:51:03,945::task::990::TaskManager.Task::(_decref) Task=`4b6ce97f-e885-4b8a-b447-48ed68354b5e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:51:04,175::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00113889 s, 437 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:51:04,274::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-34::DEBUG::2014-08-21 11:51:04,287::task::595::TaskManager.Task::(_updateState) Task=`40652197-f782-4a0c-a294-dd848d511dac`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:51:04,303::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:51:04,313::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`302566a9-763c-41e0-843d-b57488ef3be7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:51:04,316::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:51:04,318::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:51:04,320::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`302566a9-763c-41e0-843d-b57488ef3be7`::Granted request
>Thread-34::DEBUG::2014-08-21 11:51:04,325::task::827::TaskManager.Task::(resourceAcquired) Task=`40652197-f782-4a0c-a294-dd848d511dac`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:51:04,327::task::990::TaskManager.Task::(_decref) Task=`40652197-f782-4a0c-a294-dd848d511dac`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:51:04,353::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:51:04,354::task::1185::TaskManager.Task::(prepare) Task=`40652197-f782-4a0c-a294-dd848d511dac`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:51:04,355::task::595::TaskManager.Task::(_updateState) Task=`40652197-f782-4a0c-a294-dd848d511dac`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:51:04,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:51:04,357::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:51:04,359::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:51:04,360::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:51:04,361::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:51:04,362::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:51:04,363::task::990::TaskManager.Task::(_decref) Task=`40652197-f782-4a0c-a294-dd848d511dac`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:51:04,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.308125 s, 3.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:06,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:06,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0489812 s, 20.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:08,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:08,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0622321 s, 16.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:10,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:11,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552526 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:13,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:13,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.113704 s, 9.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:51:13,413::task::595::TaskManager.Task::(_updateState) Task=`f8494050-3cf8-483b-91b0-57921bdd36ac`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:51:13,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:51:13,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113889', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:51:13,415::task::1185::TaskManager.Task::(prepare) Task=`f8494050-3cf8-483b-91b0-57921bdd36ac`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113889', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:51:13,415::task::595::TaskManager.Task::(_updateState) Task=`f8494050-3cf8-483b-91b0-57921bdd36ac`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:51:13,419::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:51:13,419::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:51:13,420::task::990::TaskManager.Task::(_decref) Task=`f8494050-3cf8-483b-91b0-57921bdd36ac`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:51:14,353::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:51:14,373::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000568182 s, 876 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:51:14,385::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-13::DEBUG::2014-08-21 11:51:14,386::task::595::TaskManager.Task::(_updateState) Task=`e4572704-d9e8-411a-9580-784dfa5ab43d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:51:14,386::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:51:14,387::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:51:14,387::task::1185::TaskManager.Task::(prepare) Task=`e4572704-d9e8-411a-9580-784dfa5ab43d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:51:14,387::task::595::TaskManager.Task::(_updateState) Task=`e4572704-d9e8-411a-9580-784dfa5ab43d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:51:14,387::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:51:14,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:51:14,388::task::990::TaskManager.Task::(_decref) Task=`e4572704-d9e8-411a-9580-784dfa5ab43d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:51:14,393::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-34::DEBUG::2014-08-21 11:51:14,394::task::595::TaskManager.Task::(_updateState) Task=`7786361b-f32f-4a7d-9271-d4e6b81bf857`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:51:14,394::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:51:14,395::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a4f23316-93ae-494e-82e1-5a84ca8ea1cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:51:14,395::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:51:14,396::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:51:14,396::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a4f23316-93ae-494e-82e1-5a84ca8ea1cf`::Granted request
>Thread-34::DEBUG::2014-08-21 11:51:14,396::task::827::TaskManager.Task::(resourceAcquired) Task=`7786361b-f32f-4a7d-9271-d4e6b81bf857`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:51:14,397::task::990::TaskManager.Task::(_decref) Task=`7786361b-f32f-4a7d-9271-d4e6b81bf857`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:51:14,401::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:51:14,401::task::1185::TaskManager.Task::(prepare) Task=`7786361b-f32f-4a7d-9271-d4e6b81bf857`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:51:14,402::task::595::TaskManager.Task::(_updateState) Task=`7786361b-f32f-4a7d-9271-d4e6b81bf857`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:51:14,402::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:51:14,402::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:51:14,402::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:51:14,403::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:51:14,403::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:51:14,403::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:51:14,403::task::990::TaskManager.Task::(_decref) Task=`7786361b-f32f-4a7d-9271-d4e6b81bf857`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:51:15,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:15,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0491205 s, 20.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:17,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:17,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0735842 s, 13.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:19,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:20,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.493372 s, 2.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:22,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:23,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.541652 s, 1.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:51:24,400::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:51:24,438::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-15::DEBUG::2014-08-21 11:51:24,443::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000650115 s, 766 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:32,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:51:32,734::task::595::TaskManager.Task::(_updateState) Task=`b465ea78-b038-4f24-ab18-43953972463a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:51:32,735::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:51:32,745::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:51:34,039::task::1185::TaskManager.Task::(prepare) Task=`b465ea78-b038-4f24-ab18-43953972463a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:51:34,564::task::595::TaskManager.Task::(_updateState) Task=`b465ea78-b038-4f24-ab18-43953972463a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:51:34,565::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:51:34,565::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:51:34,566::task::990::TaskManager.Task::(_decref) Task=`b465ea78-b038-4f24-ab18-43953972463a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:51:34,890::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-34::DEBUG::2014-08-21 11:51:34,891::task::595::TaskManager.Task::(_updateState) Task=`570ab2f4-2e8a-4474-a629-d6757902ce5d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:51:34,891::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:51:34,893::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b2f9b48d-8488-4554-a99b-50531b69b8b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:51:34,893::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:51:34,894::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:51:34,894::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b2f9b48d-8488-4554-a99b-50531b69b8b0`::Granted request
>Thread-34::DEBUG::2014-08-21 11:51:34,895::task::827::TaskManager.Task::(resourceAcquired) Task=`570ab2f4-2e8a-4474-a629-d6757902ce5d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:51:34,895::task::990::TaskManager.Task::(_decref) Task=`570ab2f4-2e8a-4474-a629-d6757902ce5d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:51:35,228::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:51:35,229::task::1185::TaskManager.Task::(prepare) Task=`570ab2f4-2e8a-4474-a629-d6757902ce5d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894294528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:51:35,229::task::595::TaskManager.Task::(_updateState) Task=`570ab2f4-2e8a-4474-a629-d6757902ce5d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:51:35,230::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:51:35,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:51:35,230::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:51:35,231::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:51:35,231::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:51:35,231::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:51:35,232::task::990::TaskManager.Task::(_decref) Task=`570ab2f4-2e8a-4474-a629-d6757902ce5d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:51:35,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.2788 s, 312 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:37,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:51:39,625::task::595::TaskManager.Task::(_updateState) Task=`54d4b078-a7d1-42eb-a471-561813e09067`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:51:39,629::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:51:39,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650115', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:51:39,642::task::1185::TaskManager.Task::(prepare) Task=`54d4b078-a7d1-42eb-a471-561813e09067`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650115', 'lastCheck': '1.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:51:40,006::task::595::TaskManager.Task::(_updateState) Task=`54d4b078-a7d1-42eb-a471-561813e09067`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:51:40,007::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:51:40,009::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:51:40,009::task::990::TaskManager.Task::(_decref) Task=`54d4b078-a7d1-42eb-a471-561813e09067`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:51:50,827::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-15::DEBUG::2014-08-21 11:51:50,975::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:51:50,829::task::595::TaskManager.Task::(_updateState) Task=`6d39b37a-cb3e-45c9-b5dd-5f3ae74170d1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:51:51,117::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:51:51,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:51:51,123::task::1185::TaskManager.Task::(prepare) Task=`6d39b37a-cb3e-45c9-b5dd-5f3ae74170d1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:51:51,156::task::595::TaskManager.Task::(_updateState) Task=`6d39b37a-cb3e-45c9-b5dd-5f3ae74170d1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:51:51,162::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:51:51,169::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:51:51,179::task::990::TaskManager.Task::(_decref) Task=`6d39b37a-cb3e-45c9-b5dd-5f3ae74170d1`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:51:51,207::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00121816 s, 409 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:51:51,221::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-34::DEBUG::2014-08-21 11:51:51,226::task::595::TaskManager.Task::(_updateState) Task=`d8b9e4eb-a71c-433a-907b-205382f7dcd4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:51:51,230::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:51:51,238::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`45e10911-66a7-4612-a802-622bf4d34209`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:51:51,240::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:51:51,264::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:51:51,266::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`45e10911-66a7-4612-a802-622bf4d34209`::Granted request
>Thread-34::DEBUG::2014-08-21 11:51:51,305::task::827::TaskManager.Task::(resourceAcquired) Task=`d8b9e4eb-a71c-433a-907b-205382f7dcd4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:51:51,312::task::990::TaskManager.Task::(_decref) Task=`d8b9e4eb-a71c-433a-907b-205382f7dcd4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:51:51,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:51:51,364::task::1185::TaskManager.Task::(prepare) Task=`d8b9e4eb-a71c-433a-907b-205382f7dcd4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:51:51,366::task::595::TaskManager.Task::(_updateState) Task=`d8b9e4eb-a71c-433a-907b-205382f7dcd4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:51:51,368::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:51:51,370::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:51:51,372::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:51:51,375::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:51:51,379::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:51:51,380::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:51:51,384::task::990::TaskManager.Task::(_decref) Task=`d8b9e4eb-a71c-433a-907b-205382f7dcd4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:51:51,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.6018 s, 96.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:56,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:56,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.222228 s, 4.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:51:58,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:51:59,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.197919 s, 5.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:01,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:52:01,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-13::DEBUG::2014-08-21 11:52:01,637::task::595::TaskManager.Task::(_updateState) Task=`709ef036-a507-49e7-a8e4-6bec1163b7b8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:52:01,652::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:52:01,677::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:52:01,686::task::1185::TaskManager.Task::(prepare) Task=`709ef036-a507-49e7-a8e4-6bec1163b7b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:52:01,693::task::595::TaskManager.Task::(_updateState) Task=`709ef036-a507-49e7-a8e4-6bec1163b7b8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:52:01,704::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:52:01,712::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:52:01,720::task::990::TaskManager.Task::(_decref) Task=`709ef036-a507-49e7-a8e4-6bec1163b7b8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:52:01,766::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [10923979]
>Thread-34::DEBUG::2014-08-21 11:52:01,775::task::595::TaskManager.Task::(_updateState) Task=`13d631d0-cf04-4b29-a454-fe87848b7cd8`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:52:01,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:52:01,800::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6d03b620-5d13-49a6-be69-098b270e1b96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:52:01,805::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:52:01,816::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:52:01,822::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6d03b620-5d13-49a6-be69-098b270e1b96`::Granted request
>Thread-34::DEBUG::2014-08-21 11:52:01,839::task::827::TaskManager.Task::(resourceAcquired) Task=`13d631d0-cf04-4b29-a454-fe87848b7cd8`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:52:01,847::task::990::TaskManager.Task::(_decref) Task=`13d631d0-cf04-4b29-a454-fe87848b7cd8`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:52:01,964::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:52:02,009::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:02,019::task::1185::TaskManager.Task::(prepare) Task=`13d631d0-cf04-4b29-a454-fe87848b7cd8`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:02,028::task::595::TaskManager.Task::(_updateState) Task=`13d631d0-cf04-4b29-a454-fe87848b7cd8`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:52:02,124::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:52:02,127::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-15::DEBUG::2014-08-21 11:52:02,135::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000693768 s, 718 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:52:02,137::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:52:02,165::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:52:02,167::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:52:02,168::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:52:02,207::task::990::TaskManager.Task::(_decref) Task=`13d631d0-cf04-4b29-a454-fe87848b7cd8`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:52:02,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.70793 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:04,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:04,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0613255 s, 16.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:52:05,260::task::595::TaskManager.Task::(_updateState) Task=`600a3063-b608-441e-9771-04e31d55f0d6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:52:05,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:52:05,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693768', 'lastCheck': '3.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:52:05,262::task::1185::TaskManager.Task::(prepare) Task=`600a3063-b608-441e-9771-04e31d55f0d6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693768', 'lastCheck': '3.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:52:05,262::task::595::TaskManager.Task::(_updateState) Task=`600a3063-b608-441e-9771-04e31d55f0d6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:52:05,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:52:05,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:52:05,262::task::990::TaskManager.Task::(_decref) Task=`600a3063-b608-441e-9771-04e31d55f0d6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:52:06,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:06,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0710051 s, 14.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:09,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:09,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.356185 s, 2.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:11,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:12,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0597197 s, 17.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:52:12,282::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-13::DEBUG::2014-08-21 11:52:12,289::task::595::TaskManager.Task::(_updateState) Task=`690427ea-fa63-4d1d-ab47-b065c58528b3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:52:12,291::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:52:12,297::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:52:12,301::task::1185::TaskManager.Task::(prepare) Task=`690427ea-fa63-4d1d-ab47-b065c58528b3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:52:12,308::task::595::TaskManager.Task::(_updateState) Task=`690427ea-fa63-4d1d-ab47-b065c58528b3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:52:12,313::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:52:12,316::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:52:12,319::task::990::TaskManager.Task::(_decref) Task=`690427ea-fa63-4d1d-ab47-b065c58528b3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:52:12,339::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-34::DEBUG::2014-08-21 11:52:12,346::task::595::TaskManager.Task::(_updateState) Task=`65058980-05b2-41b2-a9f7-d006c8268931`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:52:12,350::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:52:12,359::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2e006469-9773-4a4e-b9f6-ccab19a3e3fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:52:12,362::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:52:12,369::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:52:12,371::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2e006469-9773-4a4e-b9f6-ccab19a3e3fb`::Granted request
>Thread-34::DEBUG::2014-08-21 11:52:12,382::task::827::TaskManager.Task::(resourceAcquired) Task=`65058980-05b2-41b2-a9f7-d006c8268931`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:52:12,386::task::990::TaskManager.Task::(_decref) Task=`65058980-05b2-41b2-a9f7-d006c8268931`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:52:12,531::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894818816', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:12,533::task::1185::TaskManager.Task::(prepare) Task=`65058980-05b2-41b2-a9f7-d006c8268931`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894818816', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:12,535::task::595::TaskManager.Task::(_updateState) Task=`65058980-05b2-41b2-a9f7-d006c8268931`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 11:52:12,536::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:52:12,584::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:52:12,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:52:12,586::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:52:12,587::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:52:12,588::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:52:12,588::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:52:12,589::task::990::TaskManager.Task::(_decref) Task=`65058980-05b2-41b2-a9f7-d006c8268931`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:52:12,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00738505 s, 67.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:14,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:14,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128526 s, 8.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:16,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:16,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.088542 s, 11.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:18,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:52:20,954::task::595::TaskManager.Task::(_updateState) Task=`57d6240c-0d14-4b4b-8d15-5109623c9319`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:52:20,963::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:52:20,963::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00738505', 'lastCheck': '8.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:52:20,964::task::1185::TaskManager.Task::(prepare) Task=`57d6240c-0d14-4b4b-8d15-5109623c9319`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00738505', 'lastCheck': '8.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:52:20,964::task::595::TaskManager.Task::(_updateState) Task=`57d6240c-0d14-4b4b-8d15-5109623c9319`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:52:20,964::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:52:20,965::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:52:20,965::task::990::TaskManager.Task::(_decref) Task=`57d6240c-0d14-4b4b-8d15-5109623c9319`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:52:21,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.39057 s, 428 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:52:22,682::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-13::DEBUG::2014-08-21 11:52:22,683::task::595::TaskManager.Task::(_updateState) Task=`ac0031e8-5547-4797-a66a-984b9ad8d475`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:52:22,684::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:52:22,685::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:52:22,685::task::1185::TaskManager.Task::(prepare) Task=`ac0031e8-5547-4797-a66a-984b9ad8d475`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:52:22,685::task::595::TaskManager.Task::(_updateState) Task=`ac0031e8-5547-4797-a66a-984b9ad8d475`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:52:22,686::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:52:22,686::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:52:22,686::task::990::TaskManager.Task::(_decref) Task=`ac0031e8-5547-4797-a66a-984b9ad8d475`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:52:22,692::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a0e90b9]
>Thread-34::DEBUG::2014-08-21 11:52:22,693::task::595::TaskManager.Task::(_updateState) Task=`5c324dab-b8e5-47e4-a73f-a61bf5b4e333`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:52:22,693::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:52:22,694::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`333f99f5-5d64-4f30-b936-e60ffd17ac4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:52:22,695::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:52:22,696::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:52:22,696::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`333f99f5-5d64-4f30-b936-e60ffd17ac4b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:52:22,697::task::827::TaskManager.Task::(resourceAcquired) Task=`5c324dab-b8e5-47e4-a73f-a61bf5b4e333`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:52:22,697::task::990::TaskManager.Task::(_decref) Task=`5c324dab-b8e5-47e4-a73f-a61bf5b4e333`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:52:22,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894753280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:22,707::task::1185::TaskManager.Task::(prepare) Task=`5c324dab-b8e5-47e4-a73f-a61bf5b4e333`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894753280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:22,707::task::595::TaskManager.Task::(_updateState) Task=`5c324dab-b8e5-47e4-a73f-a61bf5b4e333`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:52:22,708::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:52:22,710::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:52:22,711::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:52:22,712::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:52:22,712::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:52:22,713::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:52:22,713::task::990::TaskManager.Task::(_decref) Task=`5c324dab-b8e5-47e4-a73f-a61bf5b4e333`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:52:22,902::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:52:22,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000846558 s, 588 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:23,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:23,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0525108 s, 19.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:25,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:25,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0675419 s, 15.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:27,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:28,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.148456 s, 6.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:30,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:30,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.132762 s, 7.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:32,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:52:32,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.164363 s, 6.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:52:32,770::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-13::DEBUG::2014-08-21 11:52:32,772::task::595::TaskManager.Task::(_updateState) Task=`cef321b0-f69a-4592-8fe9-8aecb4bdadca`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:52:32,772::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:52:32,773::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:52:32,774::task::1185::TaskManager.Task::(prepare) Task=`cef321b0-f69a-4592-8fe9-8aecb4bdadca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:52:32,774::task::595::TaskManager.Task::(_updateState) Task=`cef321b0-f69a-4592-8fe9-8aecb4bdadca`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:52:32,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:52:32,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:52:32,775::task::990::TaskManager.Task::(_decref) Task=`cef321b0-f69a-4592-8fe9-8aecb4bdadca`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:52:32,781::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [48bec0d7]
>Thread-34::DEBUG::2014-08-21 11:52:32,782::task::595::TaskManager.Task::(_updateState) Task=`aea123a8-276d-45eb-82b5-1d8a7b608d83`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:52:32,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:52:32,784::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a460cdb3-acf0-4862-89da-dafd6ab31cac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:52:32,785::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:52:32,785::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:52:32,786::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a460cdb3-acf0-4862-89da-dafd6ab31cac`::Granted request
>Thread-34::DEBUG::2014-08-21 11:52:32,787::task::827::TaskManager.Task::(resourceAcquired) Task=`aea123a8-276d-45eb-82b5-1d8a7b608d83`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:52:32,787::task::990::TaskManager.Task::(_decref) Task=`aea123a8-276d-45eb-82b5-1d8a7b608d83`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:52:32,797::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894687744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:32,797::task::1185::TaskManager.Task::(prepare) Task=`aea123a8-276d-45eb-82b5-1d8a7b608d83`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894687744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:32,798::task::595::TaskManager.Task::(_updateState) Task=`aea123a8-276d-45eb-82b5-1d8a7b608d83`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:52:32,798::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:52:32,799::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:52:32,799::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:52:32,800::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:52:32,800::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:52:32,801::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:52:32,802::task::990::TaskManager.Task::(_decref) Task=`aea123a8-276d-45eb-82b5-1d8a7b608d83`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:52:33,101::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:52:33,145::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000777062 s, 641 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:52:34,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:52:39,882::task::595::TaskManager.Task::(_updateState) Task=`3df6e763-3b35-48df-9e40-845e5320f2f4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:52:39,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:52:39,890::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777062', 'lastCheck': '6.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:52:39,891::task::1185::TaskManager.Task::(prepare) Task=`3df6e763-3b35-48df-9e40-845e5320f2f4`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777062', 'lastCheck': '6.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:52:39,891::task::595::TaskManager.Task::(_updateState) Task=`3df6e763-3b35-48df-9e40-845e5320f2f4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:52:39,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:52:39,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:52:39,892::task::990::TaskManager.Task::(_decref) Task=`3df6e763-3b35-48df-9e40-845e5320f2f4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:52:56,100::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-26::DEBUG::2014-08-21 11:52:56,111::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-26::DEBUG::2014-08-21 11:52:56,126::task::595::TaskManager.Task::(_updateState) Task=`6e692f0f-7f9b-441c-9171-38e8407709db`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:52:56,144::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 11:52:56,353::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:52:56,359::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:52:56,379::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 11:52:56,394::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:52:56,397::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:52:56,398::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-26::INFO::2014-08-21 11:52:56,403::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:52:56,407::task::1185::TaskManager.Task::(prepare) Task=`6e692f0f-7f9b-441c-9171-38e8407709db`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:52:56,410::task::595::TaskManager.Task::(_updateState) Task=`6e692f0f-7f9b-441c-9171-38e8407709db`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:52:56,414::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:52:56,418::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:52:56,422::task::990::TaskManager.Task::(_decref) Task=`6e692f0f-7f9b-441c-9171-38e8407709db`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:52:56,446::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 11:52:56,459::task::595::TaskManager.Task::(_updateState) Task=`dfee0db5-85c5-48e0-a07c-14e5337b8eeb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:52:56,468::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:52:56,475::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b09819f4-758b-4c6a-8811-4ff06ce334a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:52:56,476::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:52:56,479::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:52:56,481::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b09819f4-758b-4c6a-8811-4ff06ce334a3`::Granted request
>Thread-34::DEBUG::2014-08-21 11:52:56,488::task::827::TaskManager.Task::(resourceAcquired) Task=`dfee0db5-85c5-48e0-a07c-14e5337b8eeb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:52:56,490::task::990::TaskManager.Task::(_decref) Task=`dfee0db5-85c5-48e0-a07c-14e5337b8eeb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:52:56,576::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:56,579::task::1185::TaskManager.Task::(prepare) Task=`dfee0db5-85c5-48e0-a07c-14e5337b8eeb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894622208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:52:56,581::task::595::TaskManager.Task::(_updateState) Task=`dfee0db5-85c5-48e0-a07c-14e5337b8eeb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:52:56,583::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:52:56,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:52:56,604::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:52:56,612::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:52:56,613::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:52:56,615::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:52:56,621::task::990::TaskManager.Task::(_decref) Task=`dfee0db5-85c5-48e0-a07c-14e5337b8eeb`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:52:56,728::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:53:06,158::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000794593 s, 627 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:53:06,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 31.4776 s, 32.5 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:53:06,666::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-26::DEBUG::2014-08-21 11:53:06,668::task::595::TaskManager.Task::(_updateState) Task=`f3197471-e358-461f-99cd-0282b1a67713`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:53:06,668::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:53:06,669::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:53:06,669::task::1185::TaskManager.Task::(prepare) Task=`f3197471-e358-461f-99cd-0282b1a67713`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:53:06,669::task::595::TaskManager.Task::(_updateState) Task=`f3197471-e358-461f-99cd-0282b1a67713`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:53:06,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:53:06,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:53:06,670::task::990::TaskManager.Task::(_decref) Task=`f3197471-e358-461f-99cd-0282b1a67713`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:53:06,675::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-34::DEBUG::2014-08-21 11:53:06,676::task::595::TaskManager.Task::(_updateState) Task=`82f08ca7-589a-454e-aee3-c2c0b26884c8`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:53:06,676::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:53:06,677::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`271f1905-445d-4967-88d8-50422afe0607`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:53:06,677::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:53:06,678::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:53:06,678::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`271f1905-445d-4967-88d8-50422afe0607`::Granted request
>Thread-34::DEBUG::2014-08-21 11:53:06,678::task::827::TaskManager.Task::(resourceAcquired) Task=`82f08ca7-589a-454e-aee3-c2c0b26884c8`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:53:06,678::task::990::TaskManager.Task::(_decref) Task=`82f08ca7-589a-454e-aee3-c2c0b26884c8`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:53:06,683::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:53:06,683::task::1185::TaskManager.Task::(prepare) Task=`82f08ca7-589a-454e-aee3-c2c0b26884c8`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:53:06,683::task::595::TaskManager.Task::(_updateState) Task=`82f08ca7-589a-454e-aee3-c2c0b26884c8`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:53:06,684::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:53:06,684::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:53:06,684::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:53:06,685::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:53:06,685::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:53:06,685::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:53:06,685::task::990::TaskManager.Task::(_decref) Task=`82f08ca7-589a-454e-aee3-c2c0b26884c8`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:53:16,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:53:16,494::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:53:16,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00142241 s, 350 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:53:16,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.152239 s, 6.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:53:16,702::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-26::DEBUG::2014-08-21 11:53:16,704::task::595::TaskManager.Task::(_updateState) Task=`f74fabd7-e048-4755-86b6-503f951f4535`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:53:16,704::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:53:16,705::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:53:16,705::task::1185::TaskManager.Task::(prepare) Task=`f74fabd7-e048-4755-86b6-503f951f4535`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:53:16,706::task::595::TaskManager.Task::(_updateState) Task=`f74fabd7-e048-4755-86b6-503f951f4535`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:53:16,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:53:16,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:53:16,707::task::990::TaskManager.Task::(_decref) Task=`f74fabd7-e048-4755-86b6-503f951f4535`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:53:16,717::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-34::DEBUG::2014-08-21 11:53:16,718::task::595::TaskManager.Task::(_updateState) Task=`01d5bbff-82c2-4c07-a62f-2412aecbeb87`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:53:16,719::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:53:16,720::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2101f762-0400-46b5-9578-a5cf0498506e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:53:16,720::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:53:16,720::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:53:16,721::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2101f762-0400-46b5-9578-a5cf0498506e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:53:16,721::task::827::TaskManager.Task::(resourceAcquired) Task=`01d5bbff-82c2-4c07-a62f-2412aecbeb87`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:53:16,722::task::990::TaskManager.Task::(_decref) Task=`01d5bbff-82c2-4c07-a62f-2412aecbeb87`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:53:16,729::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:53:16,729::task::1185::TaskManager.Task::(prepare) Task=`01d5bbff-82c2-4c07-a62f-2412aecbeb87`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:53:16,729::task::595::TaskManager.Task::(_updateState) Task=`01d5bbff-82c2-4c07-a62f-2412aecbeb87`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:53:16,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:53:16,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:53:16,730::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:53:16,731::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:53:16,731::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:53:16,731::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:53:16,732::task::990::TaskManager.Task::(_decref) Task=`01d5bbff-82c2-4c07-a62f-2412aecbeb87`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:53:18,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:53:18,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0481033 s, 21.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:53:20,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:53:21,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.358738 s, 2.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:53:24,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:53:24,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474266 s, 21.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:53:25,462::task::595::TaskManager.Task::(_updateState) Task=`541f6047-7e10-4603-8cf2-7aa4e15490bd`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:53:25,463::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:53:25,463::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142241', 'lastCheck': '8.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:53:25,464::task::1185::TaskManager.Task::(prepare) Task=`541f6047-7e10-4603-8cf2-7aa4e15490bd`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142241', 'lastCheck': '8.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:53:25,464::task::595::TaskManager.Task::(_updateState) Task=`541f6047-7e10-4603-8cf2-7aa4e15490bd`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:53:25,464::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:53:25,464::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:53:25,464::task::990::TaskManager.Task::(_decref) Task=`541f6047-7e10-4603-8cf2-7aa4e15490bd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:53:26,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:53:26,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0619919 s, 16.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:53:26,560::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:53:26,624::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00986388 s, 50.5 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:53:26,759::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [727d0c40]
>Thread-26::DEBUG::2014-08-21 11:53:26,761::task::595::TaskManager.Task::(_updateState) Task=`c7ad39ee-a863-42ad-a473-21387bf9ef9a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:53:26,762::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:53:26,762::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:53:26,762::task::1185::TaskManager.Task::(prepare) Task=`c7ad39ee-a863-42ad-a473-21387bf9ef9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:53:26,763::task::595::TaskManager.Task::(_updateState) Task=`c7ad39ee-a863-42ad-a473-21387bf9ef9a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:53:26,763::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:53:26,763::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:53:26,763::task::990::TaskManager.Task::(_decref) Task=`c7ad39ee-a863-42ad-a473-21387bf9ef9a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:53:26,773::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [727d0c40]
>Thread-34::DEBUG::2014-08-21 11:53:26,774::task::595::TaskManager.Task::(_updateState) Task=`e5d24731-8339-423c-ba4b-e236c4fe66b0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:53:26,795::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:53:26,796::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`00336533-46e1-4b3a-acb8-5ca1b0b9b2d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:53:26,811::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:53:26,816::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:53:27,108::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`00336533-46e1-4b3a-acb8-5ca1b0b9b2d7`::Granted request
>Thread-34::DEBUG::2014-08-21 11:53:27,109::task::827::TaskManager.Task::(resourceAcquired) Task=`e5d24731-8339-423c-ba4b-e236c4fe66b0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:53:27,109::task::990::TaskManager.Task::(_decref) Task=`e5d24731-8339-423c-ba4b-e236c4fe66b0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:53:27,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:53:27,116::task::1185::TaskManager.Task::(prepare) Task=`e5d24731-8339-423c-ba4b-e236c4fe66b0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:53:27,116::task::595::TaskManager.Task::(_updateState) Task=`e5d24731-8339-423c-ba4b-e236c4fe66b0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:53:27,116::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:53:27,117::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:53:27,117::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:53:27,118::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:53:27,118::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:53:27,118::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:53:27,119::task::990::TaskManager.Task::(_decref) Task=`e5d24731-8339-423c-ba4b-e236c4fe66b0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:53:28,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:53:28,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.134483 s, 7.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:53:30,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:53:31,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0644185 s, 15.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:53:33,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:54:00,895::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:54:10,070::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-26::DEBUG::2014-08-21 11:54:10,071::task::595::TaskManager.Task::(_updateState) Task=`7dd343bc-1262-4590-8030-5ef7f9d7271d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:54:10,072::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:54:10,073::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:54:10,134::task::1185::TaskManager.Task::(prepare) Task=`7dd343bc-1262-4590-8030-5ef7f9d7271d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:54:10,144::task::595::TaskManager.Task::(_updateState) Task=`7dd343bc-1262-4590-8030-5ef7f9d7271d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:54:10,153::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:54:10,160::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:54:10,170::task::990::TaskManager.Task::(_decref) Task=`7dd343bc-1262-4590-8030-5ef7f9d7271d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:54:10,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000426391 s, 1.2 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:54:10,216::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-34::DEBUG::2014-08-21 11:54:10,230::task::595::TaskManager.Task::(_updateState) Task=`71aa856f-b0e2-471f-98c5-b2293da11632`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:54:10,240::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:54:10,254::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`77875598-0328-4b21-a047-452161192a40`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:54:10,260::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:54:10,264::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:54:10,265::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`77875598-0328-4b21-a047-452161192a40`::Granted request
>Thread-34::DEBUG::2014-08-21 11:54:10,271::task::827::TaskManager.Task::(resourceAcquired) Task=`71aa856f-b0e2-471f-98c5-b2293da11632`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:54:10,273::task::990::TaskManager.Task::(_decref) Task=`71aa856f-b0e2-471f-98c5-b2293da11632`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:54:10,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:10,368::task::1185::TaskManager.Task::(prepare) Task=`71aa856f-b0e2-471f-98c5-b2293da11632`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:10,372::task::595::TaskManager.Task::(_updateState) Task=`71aa856f-b0e2-471f-98c5-b2293da11632`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:54:10,375::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:54:10,379::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:54:10,387::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:54:10,396::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:54:10,401::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:54:10,406::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:54:10,414::task::990::TaskManager.Task::(_decref) Task=`71aa856f-b0e2-471f-98c5-b2293da11632`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:54:10,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.98893 s, 343 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:12,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:54:13,169::task::595::TaskManager.Task::(_updateState) Task=`10ba33ed-54d4-4ae9-894a-321c9def618a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:54:13,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:54:13,170::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426391', 'lastCheck': '2.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:54:13,171::task::1185::TaskManager.Task::(prepare) Task=`10ba33ed-54d4-4ae9-894a-321c9def618a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426391', 'lastCheck': '2.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:54:13,171::task::595::TaskManager.Task::(_updateState) Task=`10ba33ed-54d4-4ae9-894a-321c9def618a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:54:13,171::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:54:13,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:54:13,195::task::990::TaskManager.Task::(_decref) Task=`10ba33ed-54d4-4ae9-894a-321c9def618a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:54:13,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.309125 s, 3.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:15,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:15,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0625535 s, 16.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:17,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:17,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.242338 s, 4.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:19,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:20,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0817031 s, 12.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:54:20,296::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:54:20,312::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00108626 s, 458 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:54:20,444::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-26::DEBUG::2014-08-21 11:54:20,445::task::595::TaskManager.Task::(_updateState) Task=`72a346ad-58b4-4d44-a66e-8c2fcd034cf8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:54:20,446::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:54:20,446::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:54:20,446::task::1185::TaskManager.Task::(prepare) Task=`72a346ad-58b4-4d44-a66e-8c2fcd034cf8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:54:20,447::task::595::TaskManager.Task::(_updateState) Task=`72a346ad-58b4-4d44-a66e-8c2fcd034cf8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:54:20,447::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:54:20,447::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:54:20,447::task::990::TaskManager.Task::(_decref) Task=`72a346ad-58b4-4d44-a66e-8c2fcd034cf8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:54:20,453::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-34::DEBUG::2014-08-21 11:54:20,454::task::595::TaskManager.Task::(_updateState) Task=`47ddd869-95ce-4c31-b6e0-1d5eeb02c433`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:54:20,454::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:54:20,455::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bc1c1b97-08db-4c34-bb15-6db394cfbcd1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:54:20,455::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:54:20,456::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:54:20,456::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bc1c1b97-08db-4c34-bb15-6db394cfbcd1`::Granted request
>Thread-34::DEBUG::2014-08-21 11:54:20,456::task::827::TaskManager.Task::(resourceAcquired) Task=`47ddd869-95ce-4c31-b6e0-1d5eeb02c433`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:54:20,457::task::990::TaskManager.Task::(_decref) Task=`47ddd869-95ce-4c31-b6e0-1d5eeb02c433`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:54:20,462::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:20,463::task::1185::TaskManager.Task::(prepare) Task=`47ddd869-95ce-4c31-b6e0-1d5eeb02c433`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:20,463::task::595::TaskManager.Task::(_updateState) Task=`47ddd869-95ce-4c31-b6e0-1d5eeb02c433`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:54:20,463::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:54:20,463::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:54:20,464::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:54:20,464::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:54:20,464::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:54:20,464::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:54:20,465::task::990::TaskManager.Task::(_decref) Task=`47ddd869-95ce-4c31-b6e0-1d5eeb02c433`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:54:22,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:22,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0863156 s, 11.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:24,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:25,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.383169 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:27,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:27,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0723725 s, 14.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:54:28,355::task::595::TaskManager.Task::(_updateState) Task=`a6140222-e8f0-43a9-a1fa-253c36455e4d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:54:28,356::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:54:28,356::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108626', 'lastCheck': '8.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:54:28,357::task::1185::TaskManager.Task::(prepare) Task=`a6140222-e8f0-43a9-a1fa-253c36455e4d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108626', 'lastCheck': '8.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:54:28,357::task::595::TaskManager.Task::(_updateState) Task=`a6140222-e8f0-43a9-a1fa-253c36455e4d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:54:28,357::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:54:28,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:54:28,358::task::990::TaskManager.Task::(_decref) Task=`a6140222-e8f0-43a9-a1fa-253c36455e4d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:54:29,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:54:31,336::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-26::DEBUG::2014-08-21 11:54:31,432::task::595::TaskManager.Task::(_updateState) Task=`aa396244-b8a4-420a-a016-415f244a07d6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:54:31,434::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:54:31,444::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:54:31,447::task::1185::TaskManager.Task::(prepare) Task=`aa396244-b8a4-420a-a016-415f244a07d6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:54:31,452::task::595::TaskManager.Task::(_updateState) Task=`aa396244-b8a4-420a-a016-415f244a07d6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:54:31,455::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:54:31,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:54:31,457::task::990::TaskManager.Task::(_decref) Task=`aa396244-b8a4-420a-a016-415f244a07d6`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:54:31,754::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 11:54:31,756::task::595::TaskManager.Task::(_updateState) Task=`2c4624e4-d392-47c6-ad7d-4cfd02d64068`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:54:31,756::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:54:31,757::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d086fcb9-b3f1-4d33-95b1-14c2cc4f3f57`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:54:31,757::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:54:31,758::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:54:31,758::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d086fcb9-b3f1-4d33-95b1-14c2cc4f3f57`::Granted request
>Thread-34::DEBUG::2014-08-21 11:54:31,758::task::827::TaskManager.Task::(resourceAcquired) Task=`2c4624e4-d392-47c6-ad7d-4cfd02d64068`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:54:31,759::task::990::TaskManager.Task::(_decref) Task=`2c4624e4-d392-47c6-ad7d-4cfd02d64068`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:54:31,763::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:31,764::task::1185::TaskManager.Task::(prepare) Task=`2c4624e4-d392-47c6-ad7d-4cfd02d64068`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894163456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:31,764::task::595::TaskManager.Task::(_updateState) Task=`2c4624e4-d392-47c6-ad7d-4cfd02d64068`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:54:31,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:54:31,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:54:31,765::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:54:31,765::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:54:31,765::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:54:31,765::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:54:31,766::task::990::TaskManager.Task::(_decref) Task=`2c4624e4-d392-47c6-ad7d-4cfd02d64068`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:54:35,503::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:54:35,579::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0079779 s, 62.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:35,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.46762 s, 158 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:37,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:37,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0748722 s, 13.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:39,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:40,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0617628 s, 16.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:54:41,945::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-13::DEBUG::2014-08-21 11:54:41,946::task::595::TaskManager.Task::(_updateState) Task=`e8cf35c1-b522-4449-a535-0253e45aaf4d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:54:41,947::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:54:41,948::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:54:41,948::task::1185::TaskManager.Task::(prepare) Task=`e8cf35c1-b522-4449-a535-0253e45aaf4d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:54:41,949::task::595::TaskManager.Task::(_updateState) Task=`e8cf35c1-b522-4449-a535-0253e45aaf4d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:54:41,949::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:54:41,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:54:42,003::task::990::TaskManager.Task::(_decref) Task=`e8cf35c1-b522-4449-a535-0253e45aaf4d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:54:42,025::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 11:54:42,026::task::595::TaskManager.Task::(_updateState) Task=`b7be9a55-36b9-41d5-837b-f849d8d158bf`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:54:42,070::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:54:42,091::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f69760c6-02eb-437d-b007-1f37327d2f6e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:54:42,104::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:54:42,115::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:54:42,119::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f69760c6-02eb-437d-b007-1f37327d2f6e`::Granted request
>Thread-34::DEBUG::2014-08-21 11:54:42,124::task::827::TaskManager.Task::(resourceAcquired) Task=`b7be9a55-36b9-41d5-837b-f849d8d158bf`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:54:42,127::task::990::TaskManager.Task::(_decref) Task=`b7be9a55-36b9-41d5-837b-f849d8d158bf`::ref 1 aborting False
>Dummy-33::DEBUG::2014-08-21 11:54:42,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::INFO::2014-08-21 11:54:42,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894687744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:42,209::task::1185::TaskManager.Task::(prepare) Task=`b7be9a55-36b9-41d5-837b-f849d8d158bf`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894687744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:42,214::task::595::TaskManager.Task::(_updateState) Task=`b7be9a55-36b9-41d5-837b-f849d8d158bf`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:54:42,216::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:54:42,218::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:54:42,220::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:54:42,222::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:54:42,223::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:54:42,224::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:54:42,226::task::990::TaskManager.Task::(_decref) Task=`b7be9a55-36b9-41d5-837b-f849d8d158bf`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:54:42,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.461711 s, 2.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:54:43,912::task::595::TaskManager.Task::(_updateState) Task=`073e476a-88e3-472b-88eb-f860ed8f3fcf`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:54:43,913::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:54:43,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0079779', 'lastCheck': '7.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:54:43,913::task::1185::TaskManager.Task::(prepare) Task=`073e476a-88e3-472b-88eb-f860ed8f3fcf`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0079779', 'lastCheck': '7.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:54:43,913::task::595::TaskManager.Task::(_updateState) Task=`073e476a-88e3-472b-88eb-f860ed8f3fcf`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:54:43,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:54:43,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:54:43,914::task::990::TaskManager.Task::(_decref) Task=`073e476a-88e3-472b-88eb-f860ed8f3fcf`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:54:44,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:44,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0721874 s, 14.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:54:46,036::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:54:46,148::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00388729 s, 128 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:46,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:47,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0822906 s, 12.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:49,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:49,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0793814 s, 12.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:51,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:51,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.11702 s, 8.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:54:52,255::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7025d910]
>Thread-13::DEBUG::2014-08-21 11:54:52,256::task::595::TaskManager.Task::(_updateState) Task=`5e4a3cf3-cffc-4fda-9e3c-a6c2e0c04ade`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:54:52,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:54:52,257::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:54:52,257::task::1185::TaskManager.Task::(prepare) Task=`5e4a3cf3-cffc-4fda-9e3c-a6c2e0c04ade`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:54:52,258::task::595::TaskManager.Task::(_updateState) Task=`5e4a3cf3-cffc-4fda-9e3c-a6c2e0c04ade`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:54:52,258::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:54:52,258::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:54:52,258::task::990::TaskManager.Task::(_decref) Task=`5e4a3cf3-cffc-4fda-9e3c-a6c2e0c04ade`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:54:52,265::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7025d910]
>Thread-34::DEBUG::2014-08-21 11:54:52,266::task::595::TaskManager.Task::(_updateState) Task=`921d6939-3887-4a59-ada7-67915778b020`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:54:52,266::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:54:52,267::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`34ba5f4e-0018-4bf1-9bc3-985d1761841b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:54:52,268::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:54:52,268::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:54:52,269::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`34ba5f4e-0018-4bf1-9bc3-985d1761841b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:54:52,270::task::827::TaskManager.Task::(resourceAcquired) Task=`921d6939-3887-4a59-ada7-67915778b020`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:54:52,270::task::990::TaskManager.Task::(_decref) Task=`921d6939-3887-4a59-ada7-67915778b020`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:54:52,275::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:52,275::task::1185::TaskManager.Task::(prepare) Task=`921d6939-3887-4a59-ada7-67915778b020`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:54:52,275::task::595::TaskManager.Task::(_updateState) Task=`921d6939-3887-4a59-ada7-67915778b020`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:54:52,276::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:54:52,276::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:54:52,277::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:54:52,277::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:54:52,277::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:54:52,277::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:54:52,278::task::990::TaskManager.Task::(_decref) Task=`921d6939-3887-4a59-ada7-67915778b020`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:54:53,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:54,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.175813 s, 5.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:54:56,219::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:54:56,240::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00113903 s, 437 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:56,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:56,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0952315 s, 10.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:54:58,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:54:58,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0857817 s, 11.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:54:59,047::task::595::TaskManager.Task::(_updateState) Task=`f843a577-6309-40df-ad49-984d693d5cca`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:54:59,047::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:54:59,048::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113903', 'lastCheck': '2.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:54:59,048::task::1185::TaskManager.Task::(prepare) Task=`f843a577-6309-40df-ad49-984d693d5cca`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113903', 'lastCheck': '2.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:54:59,048::task::595::TaskManager.Task::(_updateState) Task=`f843a577-6309-40df-ad49-984d693d5cca`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:54:59,049::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:54:59,049::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:54:59,050::task::990::TaskManager.Task::(_decref) Task=`f843a577-6309-40df-ad49-984d693d5cca`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:55:00,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:00,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476033 s, 21.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:55:02,308::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-13::DEBUG::2014-08-21 11:55:02,310::task::595::TaskManager.Task::(_updateState) Task=`1206db5f-5c12-49d1-b7dc-174e4eba3751`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:55:02,310::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:55:02,311::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:55:02,311::task::1185::TaskManager.Task::(prepare) Task=`1206db5f-5c12-49d1-b7dc-174e4eba3751`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:55:02,312::task::595::TaskManager.Task::(_updateState) Task=`1206db5f-5c12-49d1-b7dc-174e4eba3751`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:55:02,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:55:02,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:55:02,313::task::990::TaskManager.Task::(_decref) Task=`1206db5f-5c12-49d1-b7dc-174e4eba3751`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:55:02,319::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-34::DEBUG::2014-08-21 11:55:02,320::task::595::TaskManager.Task::(_updateState) Task=`0827272a-9a6a-4f26-9675-56cfa0281c3c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:55:02,320::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:55:02,321::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`67e6d37f-7856-45c1-a5f4-553da77c7e48`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:55:02,322::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:55:02,322::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:55:02,322::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`67e6d37f-7856-45c1-a5f4-553da77c7e48`::Granted request
>Thread-34::DEBUG::2014-08-21 11:55:02,323::task::827::TaskManager.Task::(resourceAcquired) Task=`0827272a-9a6a-4f26-9675-56cfa0281c3c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:55:02,324::task::990::TaskManager.Task::(_decref) Task=`0827272a-9a6a-4f26-9675-56cfa0281c3c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:55:02,329::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:55:02,329::task::1185::TaskManager.Task::(prepare) Task=`0827272a-9a6a-4f26-9675-56cfa0281c3c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894556672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:55:02,329::task::595::TaskManager.Task::(_updateState) Task=`0827272a-9a6a-4f26-9675-56cfa0281c3c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:55:02,330::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:55:02,330::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:55:02,331::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:55:02,331::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:55:02,331::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:55:02,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:55:02,332::task::990::TaskManager.Task::(_decref) Task=`0827272a-9a6a-4f26-9675-56cfa0281c3c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:55:02,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:03,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.192749 s, 5.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:05,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:05,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.16859 s, 6.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:55:06,271::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:55:06,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0014862 s, 335 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:07,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:07,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.156349 s, 6.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:09,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:10,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0865853 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:12,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:55:12,372::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [8cf019c]
>Thread-13::DEBUG::2014-08-21 11:55:12,445::task::595::TaskManager.Task::(_updateState) Task=`dba3ad3e-219a-4bd9-91ba-98c7e561666c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:55:12,446::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:55:12,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:55:12,448::task::1185::TaskManager.Task::(prepare) Task=`dba3ad3e-219a-4bd9-91ba-98c7e561666c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:55:12,448::task::595::TaskManager.Task::(_updateState) Task=`dba3ad3e-219a-4bd9-91ba-98c7e561666c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:55:12,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:55:12,454::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:55:12,469::task::990::TaskManager.Task::(_decref) Task=`dba3ad3e-219a-4bd9-91ba-98c7e561666c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:55:12,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.262092 s, 3.9 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:55:12,702::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [8cf019c]
>Thread-34::DEBUG::2014-08-21 11:55:12,710::task::595::TaskManager.Task::(_updateState) Task=`fd340cd0-867c-42d7-82f3-4ab43b7ab0d9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:55:12,733::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:55:12,736::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`55a7d280-714a-4863-9569-419c58d92125`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:55:12,738::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:55:12,740::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:55:12,741::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`55a7d280-714a-4863-9569-419c58d92125`::Granted request
>Thread-34::DEBUG::2014-08-21 11:55:12,755::task::827::TaskManager.Task::(resourceAcquired) Task=`fd340cd0-867c-42d7-82f3-4ab43b7ab0d9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:55:12,757::task::990::TaskManager.Task::(_decref) Task=`fd340cd0-867c-42d7-82f3-4ab43b7ab0d9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:55:12,779::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:55:12,781::task::1185::TaskManager.Task::(prepare) Task=`fd340cd0-867c-42d7-82f3-4ab43b7ab0d9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:55:12,783::task::595::TaskManager.Task::(_updateState) Task=`fd340cd0-867c-42d7-82f3-4ab43b7ab0d9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:55:12,784::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:55:12,784::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:55:12,807::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:55:12,808::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:55:12,809::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:55:12,811::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:55:12,813::task::990::TaskManager.Task::(_decref) Task=`fd340cd0-867c-42d7-82f3-4ab43b7ab0d9`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:55:14,218::task::595::TaskManager.Task::(_updateState) Task=`fdc3a34c-bb25-44db-9b8f-dc5a4b07ecf8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:55:14,218::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:55:14,219::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014862', 'lastCheck': '7.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:55:14,219::task::1185::TaskManager.Task::(prepare) Task=`fdc3a34c-bb25-44db-9b8f-dc5a4b07ecf8`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014862', 'lastCheck': '7.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:55:14,219::task::595::TaskManager.Task::(_updateState) Task=`fdc3a34c-bb25-44db-9b8f-dc5a4b07ecf8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:55:14,219::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:55:14,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:55:14,220::task::990::TaskManager.Task::(_decref) Task=`fdc3a34c-bb25-44db-9b8f-dc5a4b07ecf8`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:55:14,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:15,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.224113 s, 4.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:55:16,346::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:55:16,476::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000954161 s, 522 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:21,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:55:24,261::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-26::DEBUG::2014-08-21 11:55:24,263::task::595::TaskManager.Task::(_updateState) Task=`781694d5-b742-4f1e-b5e0-d291e3ce522b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:55:24,264::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:55:24,265::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:55:24,265::task::1185::TaskManager.Task::(prepare) Task=`781694d5-b742-4f1e-b5e0-d291e3ce522b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:55:24,266::task::595::TaskManager.Task::(_updateState) Task=`781694d5-b742-4f1e-b5e0-d291e3ce522b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:55:24,266::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:55:24,267::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:55:24,268::task::990::TaskManager.Task::(_decref) Task=`781694d5-b742-4f1e-b5e0-d291e3ce522b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:55:28,153::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-34::DEBUG::2014-08-21 11:55:28,155::task::595::TaskManager.Task::(_updateState) Task=`7ae6d4b7-4f9b-4c93-808e-a68de821b022`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:55:28,160::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:55:29,760::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`348ecfb1-bc58-4041-9ced-4b3bb2c5490b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:55:30,098::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:55:30,357::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:55:30,369::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`348ecfb1-bc58-4041-9ced-4b3bb2c5490b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:55:30,604::task::827::TaskManager.Task::(resourceAcquired) Task=`7ae6d4b7-4f9b-4c93-808e-a68de821b022`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:55:30,631::task::990::TaskManager.Task::(_decref) Task=`7ae6d4b7-4f9b-4c93-808e-a68de821b022`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:55:30,976::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:55:32,976::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894753280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-15::DEBUG::2014-08-21 11:55:32,873::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0356893 s, 14.0 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:55:33,343::task::1185::TaskManager.Task::(prepare) Task=`7ae6d4b7-4f9b-4c93-808e-a68de821b022`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894753280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:55:33,504::task::595::TaskManager.Task::(_updateState) Task=`7ae6d4b7-4f9b-4c93-808e-a68de821b022`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:55:33,511::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:55:33,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:55:33,514::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:55:33,516::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:55:33,518::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:55:33,518::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:55:33,520::task::990::TaskManager.Task::(_decref) Task=`7ae6d4b7-4f9b-4c93-808e-a68de821b022`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:55:33,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.25287 s, 164 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:35,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:35,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0877594 s, 11.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:37,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:40,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.1403 s, 478 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:42,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:42,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0519089 s, 19.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:55:42,593::task::595::TaskManager.Task::(_updateState) Task=`f0f9b8c1-ea97-41ea-9274-dac8f67b7f5d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:55:42,593::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:55:42,594::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0356893', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:55:42,594::task::1185::TaskManager.Task::(prepare) Task=`f0f9b8c1-ea97-41ea-9274-dac8f67b7f5d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0356893', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:55:42,594::task::595::TaskManager.Task::(_updateState) Task=`f0f9b8c1-ea97-41ea-9274-dac8f67b7f5d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:55:42,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:55:42,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:55:42,595::task::990::TaskManager.Task::(_decref) Task=`f0f9b8c1-ea97-41ea-9274-dac8f67b7f5d`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:55:44,146::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-13::DEBUG::2014-08-21 11:55:44,148::task::595::TaskManager.Task::(_updateState) Task=`e1bd7987-b163-4ce1-a87d-678004ddf908`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:55:44,149::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:55:44,150::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:55:44,150::task::1185::TaskManager.Task::(prepare) Task=`e1bd7987-b163-4ce1-a87d-678004ddf908`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:55:44,151::task::595::TaskManager.Task::(_updateState) Task=`e1bd7987-b163-4ce1-a87d-678004ddf908`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:55:44,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:55:44,153::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:55:44,156::task::990::TaskManager.Task::(_decref) Task=`e1bd7987-b163-4ce1-a87d-678004ddf908`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:55:44,163::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-34::DEBUG::2014-08-21 11:55:44,172::task::595::TaskManager.Task::(_updateState) Task=`8ac1bed8-3e9a-478c-b052-a3d9f3b81de8`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:55:44,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:55:44,176::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`17a3a6af-4978-434e-b3c9-5f9ba62afeff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:55:44,176::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:55:44,177::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:55:44,177::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`17a3a6af-4978-434e-b3c9-5f9ba62afeff`::Granted request
>Thread-34::DEBUG::2014-08-21 11:55:44,177::task::827::TaskManager.Task::(resourceAcquired) Task=`8ac1bed8-3e9a-478c-b052-a3d9f3b81de8`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:55:44,178::task::990::TaskManager.Task::(_decref) Task=`8ac1bed8-3e9a-478c-b052-a3d9f3b81de8`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:55:44,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:55:44,181::task::1185::TaskManager.Task::(prepare) Task=`8ac1bed8-3e9a-478c-b052-a3d9f3b81de8`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:55:44,182::task::595::TaskManager.Task::(_updateState) Task=`8ac1bed8-3e9a-478c-b052-a3d9f3b81de8`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:55:44,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:55:44,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:55:44,185::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:55:44,188::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:55:44,188::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:55:44,189::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:55:44,189::task::990::TaskManager.Task::(_decref) Task=`8ac1bed8-3e9a-478c-b052-a3d9f3b81de8`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:55:44,201::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:55:44,229::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00287796 s, 173 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:44,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:44,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.360068 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:46,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:46,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.162341 s, 6.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:48,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:49,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0981431 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:51,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:51,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0783824 s, 13.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:53,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:53,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.240334 s, 4.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:55:54,439::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7025d910]
>Thread-13::DEBUG::2014-08-21 11:55:54,441::task::595::TaskManager.Task::(_updateState) Task=`3ad99e04-6cef-400a-bc8a-06507499955f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:55:54,442::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:55:54,443::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:55:54,443::task::1185::TaskManager.Task::(prepare) Task=`3ad99e04-6cef-400a-bc8a-06507499955f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:55:54,444::task::595::TaskManager.Task::(_updateState) Task=`3ad99e04-6cef-400a-bc8a-06507499955f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:55:54,445::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:55:54,445::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:55:54,446::task::990::TaskManager.Task::(_decref) Task=`3ad99e04-6cef-400a-bc8a-06507499955f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:55:54,472::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:55:54,895::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7025d910]
>Thread-34::DEBUG::2014-08-21 11:55:55,071::task::595::TaskManager.Task::(_updateState) Task=`2fe4847b-509d-422f-a096-e737662d9b8b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:55:55,074::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 11:55:55,114::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0283452 s, 17.6 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:55:55,146::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`688189fd-cd78-4d53-a836-28d696ea4cd3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:55:55,307::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:55:55,346::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:55:55,346::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`688189fd-cd78-4d53-a836-28d696ea4cd3`::Granted request
>Thread-34::DEBUG::2014-08-21 11:55:55,347::task::827::TaskManager.Task::(resourceAcquired) Task=`2fe4847b-509d-422f-a096-e737662d9b8b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:55:55,348::task::990::TaskManager.Task::(_decref) Task=`2fe4847b-509d-422f-a096-e737662d9b8b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:55:55,438::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:55:55,439::task::1185::TaskManager.Task::(prepare) Task=`2fe4847b-509d-422f-a096-e737662d9b8b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:55:55,439::task::595::TaskManager.Task::(_updateState) Task=`2fe4847b-509d-422f-a096-e737662d9b8b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:55:55,440::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:55:55,440::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:55:55,441::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:55:55,458::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:55:55,459::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:55:55,459::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:55:55,460::task::990::TaskManager.Task::(_decref) Task=`2fe4847b-509d-422f-a096-e737662d9b8b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:55:56,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:56,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.447796 s, 2.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:55:58,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:55:58,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0562303 s, 18.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:55:58,987::task::595::TaskManager.Task::(_updateState) Task=`d3e5ffec-8c83-475b-985b-4a68e575a940`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:55:58,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:55:58,991::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0283452', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:55:58,992::task::1185::TaskManager.Task::(prepare) Task=`d3e5ffec-8c83-475b-985b-4a68e575a940`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0283452', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:55:58,993::task::595::TaskManager.Task::(_updateState) Task=`d3e5ffec-8c83-475b-985b-4a68e575a940`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:55:58,994::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:55:58,995::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:55:58,996::task::990::TaskManager.Task::(_decref) Task=`d3e5ffec-8c83-475b-985b-4a68e575a940`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:56:01,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:56:02,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.114915 s, 8.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:56:04,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:56:06,404::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-26::DEBUG::2014-08-21 11:56:08,591::task::595::TaskManager.Task::(_updateState) Task=`216aab59-cfba-412c-86fa-b707517424f7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:56:08,639::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:56:10,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:56:10,687::task::1185::TaskManager.Task::(prepare) Task=`216aab59-cfba-412c-86fa-b707517424f7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:56:10,688::task::595::TaskManager.Task::(_updateState) Task=`216aab59-cfba-412c-86fa-b707517424f7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:56:10,934::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:56:11,299::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:56:11,382::task::990::TaskManager.Task::(_decref) Task=`216aab59-cfba-412c-86fa-b707517424f7`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:56:11,530::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:56:11,756::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00168328 s, 296 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:56:11,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.32437 s, 140 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:56:14,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:56:15,536::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-34::DEBUG::2014-08-21 11:56:15,769::task::595::TaskManager.Task::(_updateState) Task=`2efa5f53-c6ec-4a8c-8eea-0cdb1bad64c7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:56:15,791::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:56:15,799::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3e11fd0b-481f-43be-aa7e-bd846133281d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:56:15,800::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:56:15,803::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:56:15,806::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3e11fd0b-481f-43be-aa7e-bd846133281d`::Granted request
>Thread-34::DEBUG::2014-08-21 11:56:15,820::task::827::TaskManager.Task::(resourceAcquired) Task=`2efa5f53-c6ec-4a8c-8eea-0cdb1bad64c7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:56:15,821::task::990::TaskManager.Task::(_decref) Task=`2efa5f53-c6ec-4a8c-8eea-0cdb1bad64c7`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:56:15,886::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:56:15,887::task::1185::TaskManager.Task::(prepare) Task=`2efa5f53-c6ec-4a8c-8eea-0cdb1bad64c7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:56:15,889::task::595::TaskManager.Task::(_updateState) Task=`2efa5f53-c6ec-4a8c-8eea-0cdb1bad64c7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:56:15,890::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:56:15,891::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:56:15,894::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:56:15,895::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:56:15,897::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:56:15,898::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:56:15,900::task::990::TaskManager.Task::(_decref) Task=`2efa5f53-c6ec-4a8c-8eea-0cdb1bad64c7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:56:16,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.7982 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:56:18,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:56:18,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.370013 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:56:21,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:56:23,183::task::595::TaskManager.Task::(_updateState) Task=`8b61b09b-afd1-463b-be0f-5d021e13819c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:56:23,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:56:23,185::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168328', 'lastCheck': '7.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:56:24,358::task::1185::TaskManager.Task::(prepare) Task=`8b61b09b-afd1-463b-be0f-5d021e13819c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168328', 'lastCheck': '7.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:56:24,431::task::595::TaskManager.Task::(_updateState) Task=`8b61b09b-afd1-463b-be0f-5d021e13819c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:56:25,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:56:25,306::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:56:25,307::task::990::TaskManager.Task::(_decref) Task=`8b61b09b-afd1-463b-be0f-5d021e13819c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:56:26,863::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:56:27,059::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-26::DEBUG::2014-08-21 11:56:27,234::task::595::TaskManager.Task::(_updateState) Task=`29e2abd1-8ca3-4ae1-aaf6-b6d80733537f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:56:27,235::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 11:56:30,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00186521 s, 267 kB/s\n'; <rc> = 0
>Thread-26::INFO::2014-08-21 11:56:27,239::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:56:36,244::task::1185::TaskManager.Task::(prepare) Task=`29e2abd1-8ca3-4ae1-aaf6-b6d80733537f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:56:36,456::task::595::TaskManager.Task::(_updateState) Task=`29e2abd1-8ca3-4ae1-aaf6-b6d80733537f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:56:36,474::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:56:36,475::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:56:36,476::task::990::TaskManager.Task::(_decref) Task=`29e2abd1-8ca3-4ae1-aaf6-b6d80733537f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:56:36,483::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 11:56:36,486::task::595::TaskManager.Task::(_updateState) Task=`4b7f18fa-fd6b-4552-92e3-c7238154c44f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:56:36,487::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:56:36,489::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0e08e145-8ac6-4bf7-8344-1bcd82b68166`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:56:36,490::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:56:36,492::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:56:36,492::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0e08e145-8ac6-4bf7-8344-1bcd82b68166`::Granted request
>Thread-34::DEBUG::2014-08-21 11:56:36,495::task::827::TaskManager.Task::(resourceAcquired) Task=`4b7f18fa-fd6b-4552-92e3-c7238154c44f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:56:36,496::task::990::TaskManager.Task::(_decref) Task=`4b7f18fa-fd6b-4552-92e3-c7238154c44f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:56:36,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:56:36,508::task::1185::TaskManager.Task::(prepare) Task=`4b7f18fa-fd6b-4552-92e3-c7238154c44f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:56:36,509::task::595::TaskManager.Task::(_updateState) Task=`4b7f18fa-fd6b-4552-92e3-c7238154c44f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:56:36,510::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:56:36,511::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:56:36,512::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:56:36,513::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:56:36,514::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:56:36,515::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:56:36,516::task::990::TaskManager.Task::(_decref) Task=`4b7f18fa-fd6b-4552-92e3-c7238154c44f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:56:36,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 14.6426 s, 69.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:56:38,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:56:38,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903969 s, 11.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:56:40,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:56:41,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128901 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:56:43,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:56:44,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.291402 s, 3.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:57:00,607::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-13::DEBUG::2014-08-21 11:57:00,957::task::595::TaskManager.Task::(_updateState) Task=`636a4691-9557-4f5b-980c-096d4c26684a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:57:00,957::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:57:00,958::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:57:00,958::task::1185::TaskManager.Task::(prepare) Task=`636a4691-9557-4f5b-980c-096d4c26684a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:57:00,958::task::595::TaskManager.Task::(_updateState) Task=`636a4691-9557-4f5b-980c-096d4c26684a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:57:00,959::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:57:00,959::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:57:00,959::task::990::TaskManager.Task::(_decref) Task=`636a4691-9557-4f5b-980c-096d4c26684a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:57:00,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:57:01,454::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-34::DEBUG::2014-08-21 11:57:01,687::task::595::TaskManager.Task::(_updateState) Task=`27953fe2-0b49-415e-9321-de6fec548d06`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:57:01,689::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:57:01,879::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b7803fd0-d60b-4b8d-8ad5-b97f30690688`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:57:01,893::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:57:01,894::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:57:01,895::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b7803fd0-d60b-4b8d-8ad5-b97f30690688`::Granted request
>Thread-34::DEBUG::2014-08-21 11:57:03,094::task::827::TaskManager.Task::(resourceAcquired) Task=`27953fe2-0b49-415e-9321-de6fec548d06`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:57:03,143::task::990::TaskManager.Task::(_decref) Task=`27953fe2-0b49-415e-9321-de6fec548d06`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:57:03,383::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 11:57:04,251::task::595::TaskManager.Task::(_updateState) Task=`b7a0666e-412f-4534-80a5-f7300fb98c00`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:57:04,252::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:57:04,253::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00186521', 'lastCheck': '28.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:57:04,254::task::1185::TaskManager.Task::(prepare) Task=`b7a0666e-412f-4534-80a5-f7300fb98c00`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00186521', 'lastCheck': '28.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:57:04,254::task::595::TaskManager.Task::(_updateState) Task=`b7a0666e-412f-4534-80a5-f7300fb98c00`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:57:04,255::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:57:04,317::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:57:04,327::task::990::TaskManager.Task::(_decref) Task=`b7a0666e-412f-4534-80a5-f7300fb98c00`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:57:04,365::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.02029 s, 24.5 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 11:57:04,421::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:04,428::task::1185::TaskManager.Task::(prepare) Task=`27953fe2-0b49-415e-9321-de6fec548d06`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:04,434::task::595::TaskManager.Task::(_updateState) Task=`27953fe2-0b49-415e-9321-de6fec548d06`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:57:04,443::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:57:04,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:57:04,469::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:57:04,478::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:57:04,482::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:57:04,485::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:57:04,488::task::990::TaskManager.Task::(_decref) Task=`27953fe2-0b49-415e-9321-de6fec548d06`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:57:04,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.5437 s, 289 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:06,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:06,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107009 s, 9.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:08,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:09,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.147927 s, 6.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:11,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:11,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106857 s, 9.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:13,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:13,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0614054 s, 16.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:57:14,484::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:57:14,501::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000518062 s, 961 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:57:14,507::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-26::DEBUG::2014-08-21 11:57:14,508::task::595::TaskManager.Task::(_updateState) Task=`f9112a0b-f35e-4afd-a399-c6ece78dbc9d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:57:14,508::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:57:14,508::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:57:14,509::task::1185::TaskManager.Task::(prepare) Task=`f9112a0b-f35e-4afd-a399-c6ece78dbc9d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:57:14,509::task::595::TaskManager.Task::(_updateState) Task=`f9112a0b-f35e-4afd-a399-c6ece78dbc9d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:57:14,509::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:57:14,509::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:57:14,511::task::990::TaskManager.Task::(_decref) Task=`f9112a0b-f35e-4afd-a399-c6ece78dbc9d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:57:14,515::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55d9894e]
>Thread-34::DEBUG::2014-08-21 11:57:14,516::task::595::TaskManager.Task::(_updateState) Task=`26fd949e-35ed-406d-9c81-bde94af7e4d3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:57:14,516::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:57:14,518::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3eab1f24-858e-4781-9e38-2046c4964fd3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:57:14,518::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:57:14,519::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:57:14,519::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3eab1f24-858e-4781-9e38-2046c4964fd3`::Granted request
>Thread-34::DEBUG::2014-08-21 11:57:14,520::task::827::TaskManager.Task::(resourceAcquired) Task=`26fd949e-35ed-406d-9c81-bde94af7e4d3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:57:14,520::task::990::TaskManager.Task::(_decref) Task=`26fd949e-35ed-406d-9c81-bde94af7e4d3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:57:14,554::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:14,556::task::1185::TaskManager.Task::(prepare) Task=`26fd949e-35ed-406d-9c81-bde94af7e4d3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:14,556::task::595::TaskManager.Task::(_updateState) Task=`26fd949e-35ed-406d-9c81-bde94af7e4d3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:57:14,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:57:14,557::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:57:14,557::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:57:14,557::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:57:14,558::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:57:14,558::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:57:14,559::task::990::TaskManager.Task::(_decref) Task=`26fd949e-35ed-406d-9c81-bde94af7e4d3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:57:15,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:15,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502183 s, 20.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:17,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:17,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101082 s, 10.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:57:19,606::task::595::TaskManager.Task::(_updateState) Task=`26dc91a8-1eba-4e20-9232-9001ae6d2323`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:57:19,608::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 11:57:19,608::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518062', 'lastCheck': '5.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:57:19,609::task::1185::TaskManager.Task::(prepare) Task=`26dc91a8-1eba-4e20-9232-9001ae6d2323`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518062', 'lastCheck': '5.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 11:57:19,609::task::595::TaskManager.Task::(_updateState) Task=`26dc91a8-1eba-4e20-9232-9001ae6d2323`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:57:19,610::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:57:19,610::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:57:19,610::task::990::TaskManager.Task::(_decref) Task=`26dc91a8-1eba-4e20-9232-9001ae6d2323`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:57:19,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:20,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0807077 s, 12.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:22,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:22,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0558167 s, 18.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:24,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:24,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.16199 s, 6.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:57:24,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:57:24,557::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00134276 s, 371 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:57:24,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-26::DEBUG::2014-08-21 11:57:24,582::task::595::TaskManager.Task::(_updateState) Task=`9da46b2e-9045-48dd-aa62-e97dea81ad4f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:57:24,582::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:57:24,583::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:57:24,583::task::1185::TaskManager.Task::(prepare) Task=`9da46b2e-9045-48dd-aa62-e97dea81ad4f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:57:24,583::task::595::TaskManager.Task::(_updateState) Task=`9da46b2e-9045-48dd-aa62-e97dea81ad4f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:57:24,584::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:57:24,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:57:24,584::task::990::TaskManager.Task::(_decref) Task=`9da46b2e-9045-48dd-aa62-e97dea81ad4f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:57:24,588::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 11:57:24,588::task::595::TaskManager.Task::(_updateState) Task=`cbf226e9-8d0c-49dd-baaa-6a1e1375feda`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:57:24,589::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:57:24,589::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bec38047-8da1-4c4f-ba93-4db0c39b6782`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:57:24,590::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:57:24,590::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:57:24,590::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bec38047-8da1-4c4f-ba93-4db0c39b6782`::Granted request
>Thread-34::DEBUG::2014-08-21 11:57:24,591::task::827::TaskManager.Task::(resourceAcquired) Task=`cbf226e9-8d0c-49dd-baaa-6a1e1375feda`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:57:24,591::task::990::TaskManager.Task::(_decref) Task=`cbf226e9-8d0c-49dd-baaa-6a1e1375feda`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:57:24,594::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:24,595::task::1185::TaskManager.Task::(prepare) Task=`cbf226e9-8d0c-49dd-baaa-6a1e1375feda`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:24,595::task::595::TaskManager.Task::(_updateState) Task=`cbf226e9-8d0c-49dd-baaa-6a1e1375feda`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:57:24,595::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:57:24,595::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:57:24,596::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:57:24,596::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:57:24,596::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:57:24,596::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:57:24,596::task::990::TaskManager.Task::(_decref) Task=`cbf226e9-8d0c-49dd-baaa-6a1e1375feda`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:57:26,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:30,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.97197 s, 345 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:32,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:57:45,962::task::595::TaskManager.Task::(_updateState) Task=`49f96d15-8be5-43a5-8d45-0ffbc15dab29`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:57:46,089::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:57:46,091::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134276', 'lastCheck': '21.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:57:46,091::task::1185::TaskManager.Task::(prepare) Task=`49f96d15-8be5-43a5-8d45-0ffbc15dab29`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134276', 'lastCheck': '21.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:57:46,092::task::595::TaskManager.Task::(_updateState) Task=`49f96d15-8be5-43a5-8d45-0ffbc15dab29`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:57:46,092::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:57:46,093::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:57:46,093::task::990::TaskManager.Task::(_decref) Task=`49f96d15-8be5-43a5-8d45-0ffbc15dab29`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:57:46,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 12.8866 s, 79.5 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 11:57:46,273::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-26::DEBUG::2014-08-21 11:57:46,275::task::595::TaskManager.Task::(_updateState) Task=`4501462f-f855-4ebe-92ce-d2bc2a1d7d85`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 11:57:46,382::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 11:57:46,383::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:57:46,384::task::1185::TaskManager.Task::(prepare) Task=`4501462f-f855-4ebe-92ce-d2bc2a1d7d85`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 11:57:46,384::task::595::TaskManager.Task::(_updateState) Task=`4501462f-f855-4ebe-92ce-d2bc2a1d7d85`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 11:57:46,385::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 11:57:46,386::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 11:57:46,386::task::990::TaskManager.Task::(_decref) Task=`4501462f-f855-4ebe-92ce-d2bc2a1d7d85`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:57:46,816::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-34::DEBUG::2014-08-21 11:57:46,828::task::595::TaskManager.Task::(_updateState) Task=`a0572afc-6a20-4361-8004-c63b485d9b32`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:57:46,842::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:57:46,844::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15ffc72e-8892-4a4f-b272-5479a33436e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:57:46,845::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:57:46,845::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:57:46,846::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15ffc72e-8892-4a4f-b272-5479a33436e7`::Granted request
>Thread-34::DEBUG::2014-08-21 11:57:46,983::task::827::TaskManager.Task::(resourceAcquired) Task=`a0572afc-6a20-4361-8004-c63b485d9b32`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:57:46,984::task::990::TaskManager.Task::(_decref) Task=`a0572afc-6a20-4361-8004-c63b485d9b32`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:57:47,168::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 11:57:47,339::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:47,364::task::1185::TaskManager.Task::(prepare) Task=`a0572afc-6a20-4361-8004-c63b485d9b32`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893966848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:47,522::task::595::TaskManager.Task::(_updateState) Task=`a0572afc-6a20-4361-8004-c63b485d9b32`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 11:57:47,881::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0225793 s, 22.1 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 11:57:47,881::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:57:47,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:57:47,887::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:57:47,888::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:57:47,888::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:57:47,888::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:57:47,889::task::990::TaskManager.Task::(_decref) Task=`a0572afc-6a20-4361-8004-c63b485d9b32`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:57:49,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:49,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0644424 s, 15.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:51,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:51,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.306867 s, 3.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:53,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:53,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0626482 s, 16.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:55,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:56,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.099006 s, 10.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:57:57,907::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-13::DEBUG::2014-08-21 11:57:57,909::task::595::TaskManager.Task::(_updateState) Task=`8cfd8cb3-a9bc-4510-9514-4fcf19dda75a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:57:57,909::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:57:57,910::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:57:57,910::task::1185::TaskManager.Task::(prepare) Task=`8cfd8cb3-a9bc-4510-9514-4fcf19dda75a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:57:57,911::task::595::TaskManager.Task::(_updateState) Task=`8cfd8cb3-a9bc-4510-9514-4fcf19dda75a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:57:57,911::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:57:57,911::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:57:57,911::task::990::TaskManager.Task::(_decref) Task=`8cfd8cb3-a9bc-4510-9514-4fcf19dda75a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:57:57,917::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-15::DEBUG::2014-08-21 11:57:57,917::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-34::DEBUG::2014-08-21 11:57:57,918::task::595::TaskManager.Task::(_updateState) Task=`630dc516-c932-405e-8c28-176ce1756b91`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:57:57,920::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:57:57,921::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`faaa1232-d5e0-4cee-a75d-aef0686ff478`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:57:57,921::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:57:57,922::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:57:57,922::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`faaa1232-d5e0-4cee-a75d-aef0686ff478`::Granted request
>Thread-34::DEBUG::2014-08-21 11:57:57,922::task::827::TaskManager.Task::(resourceAcquired) Task=`630dc516-c932-405e-8c28-176ce1756b91`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:57:57,923::task::990::TaskManager.Task::(_decref) Task=`630dc516-c932-405e-8c28-176ce1756b91`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 11:57:57,927::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 11:57:57,929::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 11:57:57,949::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 11:57:57,952::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 11:57:57,952::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 11:57:57,952::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-34::INFO::2014-08-21 11:57:57,963::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:57,967::task::1185::TaskManager.Task::(prepare) Task=`630dc516-c932-405e-8c28-176ce1756b91`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535895015424', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:57:57,967::task::595::TaskManager.Task::(_updateState) Task=`630dc516-c932-405e-8c28-176ce1756b91`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:57:57,968::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:57:57,969::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:57:57,971::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:57:57,972::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-15::DEBUG::2014-08-21 11:57:57,973::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:57:57,974::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:57:57,986::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:57:57,987::task::990::TaskManager.Task::(_decref) Task=`630dc516-c932-405e-8c28-176ce1756b91`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:57:57,991::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0029067 s, 171 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:57:58,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:57:58,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0722262 s, 14.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:00,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:00,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0671526 s, 15.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:58:02,211::task::595::TaskManager.Task::(_updateState) Task=`cda6a780-3f8f-426b-9c8f-90f8f57630da`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:58:02,214::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:58:02,216::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0029067', 'lastCheck': '4.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:58:02,217::task::1185::TaskManager.Task::(prepare) Task=`cda6a780-3f8f-426b-9c8f-90f8f57630da`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0029067', 'lastCheck': '4.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:58:02,219::task::595::TaskManager.Task::(_updateState) Task=`cda6a780-3f8f-426b-9c8f-90f8f57630da`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:58:02,221::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:58:02,223::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:58:02,224::task::990::TaskManager.Task::(_decref) Task=`cda6a780-3f8f-426b-9c8f-90f8f57630da`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:58:02,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:02,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0589106 s, 17.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:04,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:04,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104116 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:06,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:07,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116559 s, 8.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:58:08,009::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 11:58:08,031::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-13::DEBUG::2014-08-21 11:58:08,062::task::595::TaskManager.Task::(_updateState) Task=`fb27fd88-ee67-4551-9df2-fef19cfd5f50`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:58:08,064::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:58:08,073::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:08,076::task::1185::TaskManager.Task::(prepare) Task=`fb27fd88-ee67-4551-9df2-fef19cfd5f50`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:08,077::task::595::TaskManager.Task::(_updateState) Task=`fb27fd88-ee67-4551-9df2-fef19cfd5f50`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 11:58:08,077::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00138638 s, 359 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:58:08,078::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:58:08,084::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:58:08,085::task::990::TaskManager.Task::(_decref) Task=`fb27fd88-ee67-4551-9df2-fef19cfd5f50`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:58:08,098::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-34::DEBUG::2014-08-21 11:58:08,099::task::595::TaskManager.Task::(_updateState) Task=`761421fe-d180-42ce-8584-4c9364a1a1f2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:58:08,100::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:58:08,101::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9d6b46df-09f9-4da4-949b-2281e99cc991`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:58:08,101::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:58:08,101::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:58:08,102::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9d6b46df-09f9-4da4-949b-2281e99cc991`::Granted request
>Thread-34::DEBUG::2014-08-21 11:58:08,102::task::827::TaskManager.Task::(resourceAcquired) Task=`761421fe-d180-42ce-8584-4c9364a1a1f2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:58:08,102::task::990::TaskManager.Task::(_decref) Task=`761421fe-d180-42ce-8584-4c9364a1a1f2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:58:08,107::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:08,107::task::1185::TaskManager.Task::(prepare) Task=`761421fe-d180-42ce-8584-4c9364a1a1f2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:08,108::task::595::TaskManager.Task::(_updateState) Task=`761421fe-d180-42ce-8584-4c9364a1a1f2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:58:08,108::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:58:08,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:58:08,109::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:58:08,109::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:58:08,109::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:58:08,109::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:58:08,110::task::990::TaskManager.Task::(_decref) Task=`761421fe-d180-42ce-8584-4c9364a1a1f2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:58:09,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:09,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0720592 s, 14.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:11,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:12,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.85273 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:14,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:14,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0800286 s, 12.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:16,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:17,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.273348 s, 3.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:58:17,669::task::595::TaskManager.Task::(_updateState) Task=`97344aea-b3f4-49e9-8d4a-30c6d50c5da5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:58:17,671::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:58:17,671::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138638', 'lastCheck': '9.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:58:17,672::task::1185::TaskManager.Task::(prepare) Task=`97344aea-b3f4-49e9-8d4a-30c6d50c5da5`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138638', 'lastCheck': '9.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:58:17,672::task::595::TaskManager.Task::(_updateState) Task=`97344aea-b3f4-49e9-8d4a-30c6d50c5da5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:58:17,672::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:58:17,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:58:17,673::task::990::TaskManager.Task::(_decref) Task=`97344aea-b3f4-49e9-8d4a-30c6d50c5da5`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 11:58:18,604::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-13::DEBUG::2014-08-21 11:58:19,594::task::595::TaskManager.Task::(_updateState) Task=`b9b0a779-0a6d-4241-ae71-0c70dd9b59e7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:58:19,595::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:58:19,595::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:19,596::task::1185::TaskManager.Task::(prepare) Task=`b9b0a779-0a6d-4241-ae71-0c70dd9b59e7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:19,601::task::595::TaskManager.Task::(_updateState) Task=`b9b0a779-0a6d-4241-ae71-0c70dd9b59e7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:58:19,602::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:58:19,602::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:58:19,602::task::990::TaskManager.Task::(_decref) Task=`b9b0a779-0a6d-4241-ae71-0c70dd9b59e7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:58:19,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:58:19,649::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 11:58:19,652::task::595::TaskManager.Task::(_updateState) Task=`a4b2eb5b-cd13-47c6-af48-c0aa96f2bcc3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:58:19,652::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:58:19,653::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2f730f2a-7b4c-4d19-aebe-5afb443aeb4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:58:19,654::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:58:19,654::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:58:19,655::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2f730f2a-7b4c-4d19-aebe-5afb443aeb4b`::Granted request
>Thread-34::DEBUG::2014-08-21 11:58:19,656::task::827::TaskManager.Task::(resourceAcquired) Task=`a4b2eb5b-cd13-47c6-af48-c0aa96f2bcc3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:58:19,656::task::990::TaskManager.Task::(_decref) Task=`a4b2eb5b-cd13-47c6-af48-c0aa96f2bcc3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:58:19,663::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:19,664::task::1185::TaskManager.Task::(prepare) Task=`a4b2eb5b-cd13-47c6-af48-c0aa96f2bcc3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893770240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:19,665::task::595::TaskManager.Task::(_updateState) Task=`a4b2eb5b-cd13-47c6-af48-c0aa96f2bcc3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:58:19,665::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:58:19,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:58:19,666::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:58:19,667::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:58:19,667::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:58:19,667::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:58:19,668::task::990::TaskManager.Task::(_decref) Task=`a4b2eb5b-cd13-47c6-af48-c0aa96f2bcc3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:58:19,676::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:58:20,550::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00575699 s, 86.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:21,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.54765 s, 662 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:23,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:23,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.114714 s, 8.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:25,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:25,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0910636 s, 11.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:27,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:28,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.271995 s, 3.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:58:30,283::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-13::DEBUG::2014-08-21 11:58:30,296::task::595::TaskManager.Task::(_updateState) Task=`79ac156a-4de2-4a85-9d49-c34e881a05c0`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:58:30,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:58:30,298::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:30,298::task::1185::TaskManager.Task::(prepare) Task=`79ac156a-4de2-4a85-9d49-c34e881a05c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:30,298::task::595::TaskManager.Task::(_updateState) Task=`79ac156a-4de2-4a85-9d49-c34e881a05c0`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:58:30,299::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:58:30,299::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:58:30,300::task::990::TaskManager.Task::(_decref) Task=`79ac156a-4de2-4a85-9d49-c34e881a05c0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:58:30,306::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-34::DEBUG::2014-08-21 11:58:30,307::task::595::TaskManager.Task::(_updateState) Task=`1eff4c56-46ab-4851-801f-b7f1d80693f4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:58:30,308::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:58:30,311::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`82466393-b30e-4407-bf35-ff3701898964`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:58:30,312::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:58:30,312::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:58:30,313::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`82466393-b30e-4407-bf35-ff3701898964`::Granted request
>Thread-34::DEBUG::2014-08-21 11:58:30,314::task::827::TaskManager.Task::(resourceAcquired) Task=`1eff4c56-46ab-4851-801f-b7f1d80693f4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:58:30,315::task::990::TaskManager.Task::(_decref) Task=`1eff4c56-46ab-4851-801f-b7f1d80693f4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:58:30,380::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:30,381::task::1185::TaskManager.Task::(prepare) Task=`1eff4c56-46ab-4851-801f-b7f1d80693f4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894425600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:30,381::task::595::TaskManager.Task::(_updateState) Task=`1eff4c56-46ab-4851-801f-b7f1d80693f4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:58:30,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:58:30,389::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:58:30,424::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Dummy-33::DEBUG::2014-08-21 11:58:30,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 11:58:30,439::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:58:30,558::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:58:30,559::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:58:30,560::task::990::TaskManager.Task::(_decref) Task=`1eff4c56-46ab-4851-801f-b7f1d80693f4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:58:31,437::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:58:31,470::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000785723 s, 634 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:31,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.913574 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:58:33,151::task::595::TaskManager.Task::(_updateState) Task=`4b4c4e55-4f96-46a9-9270-5d59dd49717f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:58:33,151::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:58:33,152::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785723', 'lastCheck': '1.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:58:33,152::task::1185::TaskManager.Task::(prepare) Task=`4b4c4e55-4f96-46a9-9270-5d59dd49717f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785723', 'lastCheck': '1.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:58:33,153::task::595::TaskManager.Task::(_updateState) Task=`4b4c4e55-4f96-46a9-9270-5d59dd49717f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:58:33,153::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:58:33,154::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:58:33,154::task::990::TaskManager.Task::(_decref) Task=`4b4c4e55-4f96-46a9-9270-5d59dd49717f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:58:33,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:33,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894164 s, 11.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:35,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:36,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.184917 s, 5.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:38,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:38,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128996 s, 7.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:58:40,600::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-13::DEBUG::2014-08-21 11:58:40,601::task::595::TaskManager.Task::(_updateState) Task=`8c307775-e447-4005-8ed1-a694448d2baa`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:58:40,601::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:58:40,601::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:40,602::task::1185::TaskManager.Task::(prepare) Task=`8c307775-e447-4005-8ed1-a694448d2baa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:40,602::task::595::TaskManager.Task::(_updateState) Task=`8c307775-e447-4005-8ed1-a694448d2baa`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:58:40,602::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:58:40,602::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:58:40,602::task::990::TaskManager.Task::(_decref) Task=`8c307775-e447-4005-8ed1-a694448d2baa`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:58:40,607::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-34::DEBUG::2014-08-21 11:58:40,607::task::595::TaskManager.Task::(_updateState) Task=`6e1c5988-6686-406d-9ccd-6b7ff090b960`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:58:40,607::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:58:40,608::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a6478704-6657-40dd-b42b-579b44a3151c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:58:40,608::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:58:40,608::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:58:40,608::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a6478704-6657-40dd-b42b-579b44a3151c`::Granted request
>Thread-34::DEBUG::2014-08-21 11:58:40,609::task::827::TaskManager.Task::(resourceAcquired) Task=`6e1c5988-6686-406d-9ccd-6b7ff090b960`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:58:40,609::task::990::TaskManager.Task::(_decref) Task=`6e1c5988-6686-406d-9ccd-6b7ff090b960`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:58:40,612::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:40,612::task::1185::TaskManager.Task::(prepare) Task=`6e1c5988-6686-406d-9ccd-6b7ff090b960`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:40,613::task::595::TaskManager.Task::(_updateState) Task=`6e1c5988-6686-406d-9ccd-6b7ff090b960`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:58:40,613::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:58:40,613::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:58:40,613::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:58:40,614::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:58:40,614::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:58:40,614::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:58:40,614::task::990::TaskManager.Task::(_decref) Task=`6e1c5988-6686-406d-9ccd-6b7ff090b960`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:58:40,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:40,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0535083 s, 19.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:58:41,504::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:58:41,532::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00058487 s, 851 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:42,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:42,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0543098 s, 18.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:45,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:45,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0665151 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:58:47,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:47,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.423836 s, 2.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:58:48,318::task::595::TaskManager.Task::(_updateState) Task=`09ad848d-d252-4878-bb37-b0ac8c377f8c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:58:48,321::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:58:48,322::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058487', 'lastCheck': '6.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:58:48,323::task::1185::TaskManager.Task::(prepare) Task=`09ad848d-d252-4878-bb37-b0ac8c377f8c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058487', 'lastCheck': '6.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:58:48,323::task::595::TaskManager.Task::(_updateState) Task=`09ad848d-d252-4878-bb37-b0ac8c377f8c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:58:48,324::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:58:48,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:58:48,325::task::990::TaskManager.Task::(_decref) Task=`09ad848d-d252-4878-bb37-b0ac8c377f8c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:58:49,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:58:49,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0506229 s, 20.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:58:50,636::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-13::DEBUG::2014-08-21 11:58:50,665::task::595::TaskManager.Task::(_updateState) Task=`d2771683-9570-4be5-b45a-33617b6115f3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:58:50,666::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:58:50,666::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:50,667::task::1185::TaskManager.Task::(prepare) Task=`d2771683-9570-4be5-b45a-33617b6115f3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:58:50,667::task::595::TaskManager.Task::(_updateState) Task=`d2771683-9570-4be5-b45a-33617b6115f3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:58:50,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:58:50,668::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:58:50,668::task::990::TaskManager.Task::(_decref) Task=`d2771683-9570-4be5-b45a-33617b6115f3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:58:50,688::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 11:58:50,689::task::595::TaskManager.Task::(_updateState) Task=`9a1a14a6-5daa-4ac1-92e9-31fb719fe44d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:58:50,689::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:58:50,690::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dee33e16-cd10-4267-b887-1f5956f622cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:58:50,690::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:58:50,691::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:58:50,691::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dee33e16-cd10-4267-b887-1f5956f622cd`::Granted request
>Thread-34::DEBUG::2014-08-21 11:58:50,693::task::827::TaskManager.Task::(resourceAcquired) Task=`9a1a14a6-5daa-4ac1-92e9-31fb719fe44d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:58:50,700::task::990::TaskManager.Task::(_decref) Task=`9a1a14a6-5daa-4ac1-92e9-31fb719fe44d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:58:50,726::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:50,727::task::1185::TaskManager.Task::(prepare) Task=`9a1a14a6-5daa-4ac1-92e9-31fb719fe44d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:58:50,727::task::595::TaskManager.Task::(_updateState) Task=`9a1a14a6-5daa-4ac1-92e9-31fb719fe44d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:58:50,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:58:50,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:58:50,736::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:58:50,737::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:58:50,737::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:58:50,737::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:58:50,738::task::990::TaskManager.Task::(_decref) Task=`9a1a14a6-5daa-4ac1-92e9-31fb719fe44d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:58:58,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:58:58,730::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:59:07,327::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 1.54906 s, 0.3 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:59:07,351::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-13::DEBUG::2014-08-21 11:59:07,472::task::595::TaskManager.Task::(_updateState) Task=`1cb444a5-1391-4a07-aab2-77775b982829`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:59:07,509::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:59:07,510::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:07,510::task::1185::TaskManager.Task::(prepare) Task=`1cb444a5-1391-4a07-aab2-77775b982829`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:07,510::task::595::TaskManager.Task::(_updateState) Task=`1cb444a5-1391-4a07-aab2-77775b982829`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:59:07,511::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:59:07,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:59:07,775::task::990::TaskManager.Task::(_decref) Task=`1cb444a5-1391-4a07-aab2-77775b982829`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:59:08,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-34::DEBUG::2014-08-21 11:59:08,844::task::595::TaskManager.Task::(_updateState) Task=`8d74efad-8cae-4c29-998a-146e9f1ccae9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:59:09,066::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:59:09,068::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`90c4370e-c33b-421e-bf81-bb1318b4ae02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:59:09,068::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:59:09,092::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:59:09,095::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`90c4370e-c33b-421e-bf81-bb1318b4ae02`::Granted request
>Thread-34::DEBUG::2014-08-21 11:59:09,101::task::827::TaskManager.Task::(resourceAcquired) Task=`8d74efad-8cae-4c29-998a-146e9f1ccae9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:59:09,314::task::990::TaskManager.Task::(_decref) Task=`8d74efad-8cae-4c29-998a-146e9f1ccae9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:59:09,886::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:59:09,886::task::1185::TaskManager.Task::(prepare) Task=`8d74efad-8cae-4c29-998a-146e9f1ccae9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894360064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:59:09,887::task::595::TaskManager.Task::(_updateState) Task=`8d74efad-8cae-4c29-998a-146e9f1ccae9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:59:15,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:59:15,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:59:16,017::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:59:16,157::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:59:16,161::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:59:16,164::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:59:16,210::task::990::TaskManager.Task::(_decref) Task=`8d74efad-8cae-4c29-998a-146e9f1ccae9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:59:16,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 16.2681 s, 62.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:18,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:18,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110504 s, 9.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:59:20,277::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:21,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:59:21,821::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0936321 s, 5.3 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:59:22,036::task::595::TaskManager.Task::(_updateState) Task=`afa14a85-6970-4ecc-bf2e-75618385ae1f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:59:22,037::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:59:22,038::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '1.54906', 'lastCheck': '11.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:59:22,038::task::1185::TaskManager.Task::(prepare) Task=`afa14a85-6970-4ecc-bf2e-75618385ae1f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '1.54906', 'lastCheck': '11.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:59:22,038::task::595::TaskManager.Task::(_updateState) Task=`afa14a85-6970-4ecc-bf2e-75618385ae1f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:59:22,038::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:59:22,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:59:22,039::task::990::TaskManager.Task::(_decref) Task=`afa14a85-6970-4ecc-bf2e-75618385ae1f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:59:24,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.5014 s, 409 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:59:26,316::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-13::DEBUG::2014-08-21 11:59:26,318::task::595::TaskManager.Task::(_updateState) Task=`36077659-5196-4788-941b-350e47ea452e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:59:26,319::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:59:26,319::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:26,320::task::1185::TaskManager.Task::(prepare) Task=`36077659-5196-4788-941b-350e47ea452e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:26,321::task::595::TaskManager.Task::(_updateState) Task=`36077659-5196-4788-941b-350e47ea452e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:59:26,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:59:26,321::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:59:26,322::task::990::TaskManager.Task::(_decref) Task=`36077659-5196-4788-941b-350e47ea452e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:59:26,331::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 11:59:26,332::task::595::TaskManager.Task::(_updateState) Task=`94668371-f475-4c3a-be24-9566cdfdde07`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:59:26,333::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:59:26,334::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7e9c7dbc-a16c-4f08-bd5e-b8a72684def6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:59:26,334::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:59:26,335::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:59:26,335::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7e9c7dbc-a16c-4f08-bd5e-b8a72684def6`::Granted request
>Thread-34::DEBUG::2014-08-21 11:59:26,336::task::827::TaskManager.Task::(resourceAcquired) Task=`94668371-f475-4c3a-be24-9566cdfdde07`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:59:26,336::task::990::TaskManager.Task::(_decref) Task=`94668371-f475-4c3a-be24-9566cdfdde07`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:59:26,357::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:59:26,358::task::1185::TaskManager.Task::(prepare) Task=`94668371-f475-4c3a-be24-9566cdfdde07`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894491136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:59:26,358::task::595::TaskManager.Task::(_updateState) Task=`94668371-f475-4c3a-be24-9566cdfdde07`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:59:26,359::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:59:26,359::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:59:26,360::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:59:26,361::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:59:26,362::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:59:26,363::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:59:26,365::task::990::TaskManager.Task::(_decref) Task=`94668371-f475-4c3a-be24-9566cdfdde07`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:59:26,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:26,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0751688 s, 13.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:28,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:29,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.750753 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:31,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:31,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0542529 s, 18.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:33,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:33,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.135108 s, 7.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:59:34,304::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:59:34,319::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000775865 s, 642 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:35,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:36,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0523767 s, 19.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:59:36,386::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-13::DEBUG::2014-08-21 11:59:36,387::task::595::TaskManager.Task::(_updateState) Task=`dc2908ca-e9d0-4245-b4fc-54f75829e084`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:59:36,388::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:59:36,388::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:36,388::task::1185::TaskManager.Task::(prepare) Task=`dc2908ca-e9d0-4245-b4fc-54f75829e084`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:36,389::task::595::TaskManager.Task::(_updateState) Task=`dc2908ca-e9d0-4245-b4fc-54f75829e084`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:59:36,389::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:59:36,389::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:59:36,389::task::990::TaskManager.Task::(_decref) Task=`dc2908ca-e9d0-4245-b4fc-54f75829e084`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:59:36,394::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74a062c8]
>Thread-34::DEBUG::2014-08-21 11:59:36,395::task::595::TaskManager.Task::(_updateState) Task=`b9f097c7-940e-43f9-91c9-37d82e8685bb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:59:36,395::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:59:36,398::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`19f5d3be-8ac2-4d61-932c-184596efc905`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:59:36,399::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:59:36,400::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:59:36,400::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`19f5d3be-8ac2-4d61-932c-184596efc905`::Granted request
>Thread-34::DEBUG::2014-08-21 11:59:36,401::task::827::TaskManager.Task::(resourceAcquired) Task=`b9f097c7-940e-43f9-91c9-37d82e8685bb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:59:36,401::task::990::TaskManager.Task::(_decref) Task=`b9f097c7-940e-43f9-91c9-37d82e8685bb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:59:36,408::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:59:36,410::task::1185::TaskManager.Task::(prepare) Task=`b9f097c7-940e-43f9-91c9-37d82e8685bb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535893901312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:59:36,411::task::595::TaskManager.Task::(_updateState) Task=`b9f097c7-940e-43f9-91c9-37d82e8685bb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:59:36,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:59:36,414::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:59:36,415::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:59:36,417::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:59:36,418::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:59:36,419::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:59:36,421::task::990::TaskManager.Task::(_decref) Task=`b9f097c7-940e-43f9-91c9-37d82e8685bb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:59:38,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:38,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0519732 s, 19.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:59:39,114::task::595::TaskManager.Task::(_updateState) Task=`29c3c537-afcf-44e1-be60-2291047faa0f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:59:39,115::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:59:39,115::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775865', 'lastCheck': '4.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:59:39,115::task::1185::TaskManager.Task::(prepare) Task=`29c3c537-afcf-44e1-be60-2291047faa0f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775865', 'lastCheck': '4.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:59:39,116::task::595::TaskManager.Task::(_updateState) Task=`29c3c537-afcf-44e1-be60-2291047faa0f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:59:39,116::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:59:39,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:59:39,116::task::990::TaskManager.Task::(_decref) Task=`29c3c537-afcf-44e1-be60-2291047faa0f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:59:40,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:40,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.12098 s, 8.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:42,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:42,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0686228 s, 14.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 11:59:44,340::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:59:44,355::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00060985 s, 817 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:44,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:44,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0791539 s, 12.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:59:46,443::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-13::DEBUG::2014-08-21 11:59:46,444::task::595::TaskManager.Task::(_updateState) Task=`16c512d8-915a-430f-82cc-f428da871fc1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:59:46,444::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:59:46,445::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:46,445::task::1185::TaskManager.Task::(prepare) Task=`16c512d8-915a-430f-82cc-f428da871fc1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:46,445::task::595::TaskManager.Task::(_updateState) Task=`16c512d8-915a-430f-82cc-f428da871fc1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:59:46,446::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:59:46,446::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:59:46,446::task::990::TaskManager.Task::(_decref) Task=`16c512d8-915a-430f-82cc-f428da871fc1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 11:59:46,512::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-34::DEBUG::2014-08-21 11:59:46,513::task::595::TaskManager.Task::(_updateState) Task=`ece800e5-f98f-41eb-8952-c6d443469ccb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 11:59:46,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 11:59:46,514::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eed1510b-2f20-424c-88ee-94ac43d2d173`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 11:59:46,515::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 11:59:46,522::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 11:59:46,523::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`eed1510b-2f20-424c-88ee-94ac43d2d173`::Granted request
>Thread-34::DEBUG::2014-08-21 11:59:46,523::task::827::TaskManager.Task::(resourceAcquired) Task=`ece800e5-f98f-41eb-8952-c6d443469ccb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 11:59:46,524::task::990::TaskManager.Task::(_decref) Task=`ece800e5-f98f-41eb-8952-c6d443469ccb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 11:59:46,530::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:59:46,531::task::1185::TaskManager.Task::(prepare) Task=`ece800e5-f98f-41eb-8952-c6d443469ccb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894228992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 11:59:46,531::task::595::TaskManager.Task::(_updateState) Task=`ece800e5-f98f-41eb-8952-c6d443469ccb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 11:59:46,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 11:59:46,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 11:59:46,532::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 11:59:46,537::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 11:59:46,538::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 11:59:46,538::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 11:59:46,539::task::990::TaskManager.Task::(_decref) Task=`ece800e5-f98f-41eb-8952-c6d443469ccb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:59:46,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:47,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.256316 s, 4.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:49,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:49,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100776 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:51,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:52,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.773227 s, 1.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:59:54,268::task::595::TaskManager.Task::(_updateState) Task=`fa765113-cf71-4e7b-a5f6-1247edc9155b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:59:54,268::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 11:59:54,269::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060985', 'lastCheck': '9.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:59:54,269::task::1185::TaskManager.Task::(prepare) Task=`fa765113-cf71-4e7b-a5f6-1247edc9155b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060985', 'lastCheck': '9.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 11:59:54,269::task::595::TaskManager.Task::(_updateState) Task=`fa765113-cf71-4e7b-a5f6-1247edc9155b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:59:54,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:59:54,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:59:54,270::task::990::TaskManager.Task::(_decref) Task=`fa765113-cf71-4e7b-a5f6-1247edc9155b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 11:59:54,376::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 11:59:54,394::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00055289 s, 901 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:54,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:54,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103122 s, 9.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 11:59:56,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 11:59:57,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.230429 s, 4.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 11:59:57,205::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-13::DEBUG::2014-08-21 11:59:57,207::task::595::TaskManager.Task::(_updateState) Task=`fe9df387-acfb-4c99-8e64-950e8c078947`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 11:59:57,207::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 11:59:57,208::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:57,209::task::1185::TaskManager.Task::(prepare) Task=`fe9df387-acfb-4c99-8e64-950e8c078947`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 11:59:57,209::task::595::TaskManager.Task::(_updateState) Task=`fe9df387-acfb-4c99-8e64-950e8c078947`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 11:59:57,301::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 11:59:57,304::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 11:59:57,349::task::990::TaskManager.Task::(_decref) Task=`fe9df387-acfb-4c99-8e64-950e8c078947`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 11:59:59,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:00:00,711::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 12:00:00,722::task::595::TaskManager.Task::(_updateState) Task=`3c21e188-e499-4d83-b39b-8846115263c4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:00:00,725::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:00:00,733::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ef1c9c9b-ceed-4d35-93d1-bf557a4e5811`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:00:00,734::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:00:00,736::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:00:00,737::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ef1c9c9b-ceed-4d35-93d1-bf557a4e5811`::Granted request
>Thread-34::DEBUG::2014-08-21 12:00:00,740::task::827::TaskManager.Task::(resourceAcquired) Task=`3c21e188-e499-4d83-b39b-8846115263c4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:00:00,741::task::990::TaskManager.Task::(_decref) Task=`3c21e188-e499-4d83-b39b-8846115263c4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:00:00,766::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:00:00,768::task::1185::TaskManager.Task::(prepare) Task=`3c21e188-e499-4d83-b39b-8846115263c4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894032384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:00:00,770::task::595::TaskManager.Task::(_updateState) Task=`3c21e188-e499-4d83-b39b-8846115263c4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:00:00,771::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:00:00,772::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:00:00,774::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:00:00,776::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:00:00,777::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:00:00,778::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:00:00,780::task::990::TaskManager.Task::(_decref) Task=`3c21e188-e499-4d83-b39b-8846115263c4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:00:00,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.16932 s, 876 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:03,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:00:03,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0640017 s, 16.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:00:04,795::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:00:05,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:00:06,263::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00906967 s, 54.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:07,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.43463 s, 714 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:09,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:00:11,347::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-26::DEBUG::2014-08-21 12:00:11,417::task::595::TaskManager.Task::(_updateState) Task=`7f03eeb4-23d0-49bb-ba92-431355a88c10`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:00:11,649::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:00:11,654::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:00:11,655::task::1185::TaskManager.Task::(prepare) Task=`7f03eeb4-23d0-49bb-ba92-431355a88c10`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:00:11,656::task::595::TaskManager.Task::(_updateState) Task=`7f03eeb4-23d0-49bb-ba92-431355a88c10`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:00:11,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:00:11,657::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:00:11,658::task::990::TaskManager.Task::(_decref) Task=`7f03eeb4-23d0-49bb-ba92-431355a88c10`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:00:11,688::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 12:00:11,691::task::595::TaskManager.Task::(_updateState) Task=`aa85b2a6-049d-4cb8-89d8-242ec2c5861d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:00:11,691::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:00:11,693::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a4021a2c-f7d7-4636-bddd-51b2af4932f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:00:11,693::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:00:11,694::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:00:11,695::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a4021a2c-f7d7-4636-bddd-51b2af4932f0`::Granted request
>Thread-34::DEBUG::2014-08-21 12:00:11,696::task::827::TaskManager.Task::(resourceAcquired) Task=`aa85b2a6-049d-4cb8-89d8-242ec2c5861d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:00:11,696::task::990::TaskManager.Task::(_decref) Task=`aa85b2a6-049d-4cb8-89d8-242ec2c5861d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:00:11,705::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:00:11,706::task::1185::TaskManager.Task::(prepare) Task=`aa85b2a6-049d-4cb8-89d8-242ec2c5861d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535894097920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:00:11,706::task::595::TaskManager.Task::(_updateState) Task=`aa85b2a6-049d-4cb8-89d8-242ec2c5861d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:00:11,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:00:11,709::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:00:11,709::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:00:11,710::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:00:11,710::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:00:11,710::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:00:11,711::task::990::TaskManager.Task::(_decref) Task=`aa85b2a6-049d-4cb8-89d8-242ec2c5861d`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:00:13,762::task::595::TaskManager.Task::(_updateState) Task=`ee80f0f6-1bd3-4d2f-ac4e-55f6de9025b3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:00:13,765::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:00:13,767::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00906967', 'lastCheck': '6.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:00:13,767::task::1185::TaskManager.Task::(prepare) Task=`ee80f0f6-1bd3-4d2f-ac4e-55f6de9025b3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00906967', 'lastCheck': '6.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:00:13,768::task::595::TaskManager.Task::(_updateState) Task=`ee80f0f6-1bd3-4d2f-ac4e-55f6de9025b3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:00:13,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:00:13,769::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:00:13,769::task::990::TaskManager.Task::(_decref) Task=`ee80f0f6-1bd3-4d2f-ac4e-55f6de9025b3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:00:14,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.70027 s, 218 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:16,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:00:16,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0864162 s, 11.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:00:16,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:00:16,908::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0134056 s, 37.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:18,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:00:18,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.050709 s, 20.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:20,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:00:20,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.409186 s, 2.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:00:21,729::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-26::DEBUG::2014-08-21 12:00:21,730::task::595::TaskManager.Task::(_updateState) Task=`fff468a0-ed46-428c-9c16-eafd42919f72`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:00:21,731::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:00:21,732::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:00:21,733::task::1185::TaskManager.Task::(prepare) Task=`fff468a0-ed46-428c-9c16-eafd42919f72`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:00:21,733::task::595::TaskManager.Task::(_updateState) Task=`fff468a0-ed46-428c-9c16-eafd42919f72`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:00:21,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:00:21,734::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:00:21,735::task::990::TaskManager.Task::(_decref) Task=`fff468a0-ed46-428c-9c16-eafd42919f72`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:00:21,751::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1b412cfe]
>Thread-34::DEBUG::2014-08-21 12:00:21,752::task::595::TaskManager.Task::(_updateState) Task=`11b0981d-8518-4716-8362-c690b1da4dd6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:00:21,753::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:00:21,777::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`39bbae61-6bca-4ca3-b1eb-eac758d0193a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:00:21,779::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:00:21,781::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:00:21,784::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`39bbae61-6bca-4ca3-b1eb-eac758d0193a`::Granted request
>Thread-34::DEBUG::2014-08-21 12:00:21,788::task::827::TaskManager.Task::(resourceAcquired) Task=`11b0981d-8518-4716-8362-c690b1da4dd6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:00:21,789::task::990::TaskManager.Task::(_decref) Task=`11b0981d-8518-4716-8362-c690b1da4dd6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:00:21,814::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:00:21,815::task::1185::TaskManager.Task::(prepare) Task=`11b0981d-8518-4716-8362-c690b1da4dd6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:00:21,816::task::595::TaskManager.Task::(_updateState) Task=`11b0981d-8518-4716-8362-c690b1da4dd6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:00:21,817::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:00:21,818::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:00:21,820::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:00:21,821::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:00:21,822::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:00:21,823::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:00:21,825::task::990::TaskManager.Task::(_decref) Task=`11b0981d-8518-4716-8362-c690b1da4dd6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:00:23,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:00:23,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.29618 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:25,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:00:25,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.3785 s, 2.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:00:27,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:00:27,074::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000972104 s, 512 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:28,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:00:30,227::task::595::TaskManager.Task::(_updateState) Task=`7ab452aa-ff38-4452-950f-631b24d06fa0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:00:31,357::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:00:31,370::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000972104', 'lastCheck': '4.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:00:31,371::task::1185::TaskManager.Task::(prepare) Task=`7ab452aa-ff38-4452-950f-631b24d06fa0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000972104', 'lastCheck': '4.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:00:31,412::task::595::TaskManager.Task::(_updateState) Task=`7ab452aa-ff38-4452-950f-631b24d06fa0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:00:31,422::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:00:31,427::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:00:31,431::task::990::TaskManager.Task::(_decref) Task=`7ab452aa-ff38-4452-950f-631b24d06fa0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:00:31,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.21265 s, 319 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:00:31,959::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Dummy-33::DEBUG::2014-08-21 12:00:36,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:00:36,683::task::595::TaskManager.Task::(_updateState) Task=`f19dffdc-65d0-4446-b5d0-e34ced4ab303`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:00:36,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:00:37,111::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:00:37,240::task::1185::TaskManager.Task::(prepare) Task=`f19dffdc-65d0-4446-b5d0-e34ced4ab303`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:00:37,329::task::595::TaskManager.Task::(_updateState) Task=`f19dffdc-65d0-4446-b5d0-e34ced4ab303`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:00:39,098::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:00:41,119::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:00:41,120::task::990::TaskManager.Task::(_decref) Task=`f19dffdc-65d0-4446-b5d0-e34ced4ab303`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:00:44,034::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:00:44,258::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-34::DEBUG::2014-08-21 12:00:44,276::task::595::TaskManager.Task::(_updateState) Task=`f7e1ed74-bf53-482f-9567-0af8a47e64cd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:00:44,309::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:00:44,311::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7bbb79a2-f95d-400e-9b69-acb012e57442`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:00:44,312::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:00:44,356::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:00:44,357::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7bbb79a2-f95d-400e-9b69-acb012e57442`::Granted request
>Thread-15::DEBUG::2014-08-21 12:00:44,589::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0522212 s, 9.5 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:00:44,614::task::827::TaskManager.Task::(resourceAcquired) Task=`f7e1ed74-bf53-482f-9567-0af8a47e64cd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:00:44,944::task::990::TaskManager.Task::(_decref) Task=`f7e1ed74-bf53-482f-9567-0af8a47e64cd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:00:47,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:00:47,477::task::1185::TaskManager.Task::(prepare) Task=`f7e1ed74-bf53-482f-9567-0af8a47e64cd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:00:47,478::task::595::TaskManager.Task::(_updateState) Task=`f7e1ed74-bf53-482f-9567-0af8a47e64cd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:00:47,478::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:00:47,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:00:47,503::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:00:47,504::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:00:47,504::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:00:47,510::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:00:47,512::task::990::TaskManager.Task::(_decref) Task=`f7e1ed74-bf53-482f-9567-0af8a47e64cd`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:00:48,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 11.6732 s, 87.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:50,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:00:55,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.55627 s, 401 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:00:55,576::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:00:55,787::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0448601 s, 11.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:00:57,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:00:57,884::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-13::DEBUG::2014-08-21 12:00:57,895::task::595::TaskManager.Task::(_updateState) Task=`84d0bb8a-0a57-42ab-af8d-e76efb45bfa3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:00:58,065::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:00:58,604::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:00:58,708::task::1185::TaskManager.Task::(prepare) Task=`84d0bb8a-0a57-42ab-af8d-e76efb45bfa3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:00:58,830::task::595::TaskManager.Task::(_updateState) Task=`4b88a7b5-dd37-4842-b0fe-d81633cf9e65`::moving from state init -> state preparing
>Thread-13::DEBUG::2014-08-21 12:00:58,974::task::595::TaskManager.Task::(_updateState) Task=`84d0bb8a-0a57-42ab-af8d-e76efb45bfa3`::moving from state preparing -> state finished
>Thread-26::INFO::2014-08-21 12:00:59,069::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:00:59,078::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0448601', 'lastCheck': '3.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:00:59,099::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:00:59,118::task::1185::TaskManager.Task::(prepare) Task=`4b88a7b5-dd37-4842-b0fe-d81633cf9e65`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0448601', 'lastCheck': '3.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:00:59,238::task::595::TaskManager.Task::(_updateState) Task=`4b88a7b5-dd37-4842-b0fe-d81633cf9e65`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:00:59,247::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:00:59,250::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:00:59,235::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:00:59,448::task::990::TaskManager.Task::(_decref) Task=`4b88a7b5-dd37-4842-b0fe-d81633cf9e65`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:00:59,437::task::990::TaskManager.Task::(_decref) Task=`84d0bb8a-0a57-42ab-af8d-e76efb45bfa3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:01:01,251::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-34::DEBUG::2014-08-21 12:01:01,278::task::595::TaskManager.Task::(_updateState) Task=`6c6d7f94-9095-42dc-88d5-d3c034a6beab`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:01:01,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:01:02,465::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`be86dc24-80d1-49e1-b2e2-fb6ac2bfb224`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:01:02,469::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:01:02,514::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:01:03,491::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`be86dc24-80d1-49e1-b2e2-fb6ac2bfb224`::Granted request
>Thread-34::DEBUG::2014-08-21 12:01:03,492::task::827::TaskManager.Task::(resourceAcquired) Task=`6c6d7f94-9095-42dc-88d5-d3c034a6beab`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:01:03,493::task::990::TaskManager.Task::(_decref) Task=`6c6d7f94-9095-42dc-88d5-d3c034a6beab`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:01:03,499::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:03,500::task::1185::TaskManager.Task::(prepare) Task=`6c6d7f94-9095-42dc-88d5-d3c034a6beab`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:03,500::task::595::TaskManager.Task::(_updateState) Task=`6c6d7f94-9095-42dc-88d5-d3c034a6beab`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:01:03,500::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:01:03,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:01:03,501::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:01:03,502::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:01:03,502::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:01:03,502::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:01:03,503::task::990::TaskManager.Task::(_decref) Task=`6c6d7f94-9095-42dc-88d5-d3c034a6beab`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:01:08,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:01:08,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00126774 s, 393 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:01:10,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 11.1695 s, 91.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:01:12,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:01:14,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.13808 s, 900 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:01:16,006::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-26::DEBUG::2014-08-21 12:01:16,007::task::595::TaskManager.Task::(_updateState) Task=`9b69a141-e919-45a4-a1ed-c42f469e379c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:01:16,008::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:01:16,008::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:01:16,009::task::1185::TaskManager.Task::(prepare) Task=`9b69a141-e919-45a4-a1ed-c42f469e379c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:01:16,009::task::595::TaskManager.Task::(_updateState) Task=`9b69a141-e919-45a4-a1ed-c42f469e379c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:01:16,009::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:01:16,010::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:01:16,010::task::990::TaskManager.Task::(_decref) Task=`9b69a141-e919-45a4-a1ed-c42f469e379c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:01:16,015::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3dcd1035]
>Thread-34::DEBUG::2014-08-21 12:01:16,015::task::595::TaskManager.Task::(_updateState) Task=`c15f545a-fe18-4bbd-bbb2-2e0ff1f88c57`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:01:16,015::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:01:16,016::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5950130b-7aa9-49b9-83b6-a8d522761bc3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:01:16,016::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:01:16,017::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:01:16,017::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5950130b-7aa9-49b9-83b6-a8d522761bc3`::Granted request
>Thread-34::DEBUG::2014-08-21 12:01:16,018::task::827::TaskManager.Task::(resourceAcquired) Task=`c15f545a-fe18-4bbd-bbb2-2e0ff1f88c57`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:01:16,018::task::990::TaskManager.Task::(_decref) Task=`c15f545a-fe18-4bbd-bbb2-2e0ff1f88c57`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:01:16,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:16,022::task::1185::TaskManager.Task::(prepare) Task=`c15f545a-fe18-4bbd-bbb2-2e0ff1f88c57`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:16,023::task::595::TaskManager.Task::(_updateState) Task=`c15f545a-fe18-4bbd-bbb2-2e0ff1f88c57`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:01:16,023::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:01:16,023::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:01:16,024::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:01:16,024::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:01:16,025::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:01:16,025::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:01:16,025::task::990::TaskManager.Task::(_decref) Task=`c15f545a-fe18-4bbd-bbb2-2e0ff1f88c57`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:01:16,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:01:17,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150871 s, 6.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:01:19,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:01:19,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.232395 s, 4.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:01:19,768::task::595::TaskManager.Task::(_updateState) Task=`9d1ead1b-b8ba-478d-aa12-f219c075c121`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:01:19,769::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:01:19,769::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00126774', 'lastCheck': '9.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:01:19,769::task::1185::TaskManager.Task::(prepare) Task=`9d1ead1b-b8ba-478d-aa12-f219c075c121`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00126774', 'lastCheck': '9.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:01:19,770::task::595::TaskManager.Task::(_updateState) Task=`9d1ead1b-b8ba-478d-aa12-f219c075c121`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:01:19,770::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:01:19,770::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:01:19,771::task::990::TaskManager.Task::(_decref) Task=`9d1ead1b-b8ba-478d-aa12-f219c075c121`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:01:20,572::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:01:20,617::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0016341 s, 305 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:01:21,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:01:22,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.791512 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:01:24,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:01:25,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.409429 s, 2.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:01:26,047::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-26::DEBUG::2014-08-21 12:01:26,048::task::595::TaskManager.Task::(_updateState) Task=`9a25ffc1-0a8f-47d2-975f-23a9156a5197`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:01:26,049::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:01:26,050::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:01:26,050::task::1185::TaskManager.Task::(prepare) Task=`9a25ffc1-0a8f-47d2-975f-23a9156a5197`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:01:26,050::task::595::TaskManager.Task::(_updateState) Task=`9a25ffc1-0a8f-47d2-975f-23a9156a5197`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:01:26,050::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:01:26,051::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:01:26,051::task::990::TaskManager.Task::(_decref) Task=`9a25ffc1-0a8f-47d2-975f-23a9156a5197`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:01:26,055::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [783cab0a]
>Thread-34::DEBUG::2014-08-21 12:01:26,056::task::595::TaskManager.Task::(_updateState) Task=`ba5d1b2f-ddd0-4cf8-a176-b4d065ebaeae`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:01:26,056::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:01:26,057::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b00feddb-87de-421d-9c4b-3e836204060f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:01:26,057::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:01:26,058::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:01:26,058::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b00feddb-87de-421d-9c4b-3e836204060f`::Granted request
>Thread-34::DEBUG::2014-08-21 12:01:26,059::task::827::TaskManager.Task::(resourceAcquired) Task=`ba5d1b2f-ddd0-4cf8-a176-b4d065ebaeae`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:01:26,059::task::990::TaskManager.Task::(_decref) Task=`ba5d1b2f-ddd0-4cf8-a176-b4d065ebaeae`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:01:26,065::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:26,065::task::1185::TaskManager.Task::(prepare) Task=`ba5d1b2f-ddd0-4cf8-a176-b4d065ebaeae`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:26,065::task::595::TaskManager.Task::(_updateState) Task=`ba5d1b2f-ddd0-4cf8-a176-b4d065ebaeae`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:01:26,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:01:26,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:01:26,066::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:01:26,066::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:01:26,067::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:01:26,067::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:01:26,067::task::990::TaskManager.Task::(_decref) Task=`ba5d1b2f-ddd0-4cf8-a176-b4d065ebaeae`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:01:27,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:01:37,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-13::DEBUG::2014-08-21 12:01:37,038::task::595::TaskManager.Task::(_updateState) Task=`f8fcb72d-9434-4081-b643-a8c89dc8a9a7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:01:37,038::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:01:37,039::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:01:37,039::task::1185::TaskManager.Task::(prepare) Task=`f8fcb72d-9434-4081-b643-a8c89dc8a9a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:01:37,039::task::595::TaskManager.Task::(_updateState) Task=`f8fcb72d-9434-4081-b643-a8c89dc8a9a7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:01:37,040::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:01:37,209::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:01:37,316::task::990::TaskManager.Task::(_decref) Task=`f8fcb72d-9434-4081-b643-a8c89dc8a9a7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:01:37,643::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-34::DEBUG::2014-08-21 12:01:37,649::task::595::TaskManager.Task::(_updateState) Task=`30ba920e-0405-4d66-9c89-1c07dd162b3c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:01:37,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:01:37,661::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`348a6000-b0d4-436f-bfcc-1a09326e7fb9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:01:37,663::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:01:37,670::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:01:37,673::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`348a6000-b0d4-436f-bfcc-1a09326e7fb9`::Granted request
>Thread-34::DEBUG::2014-08-21 12:01:37,681::task::827::TaskManager.Task::(resourceAcquired) Task=`30ba920e-0405-4d66-9c89-1c07dd162b3c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:01:37,683::task::990::TaskManager.Task::(_decref) Task=`30ba920e-0405-4d66-9c89-1c07dd162b3c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:01:37,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:37,745::task::1185::TaskManager.Task::(prepare) Task=`30ba920e-0405-4d66-9c89-1c07dd162b3c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:37,750::task::595::TaskManager.Task::(_updateState) Task=`30ba920e-0405-4d66-9c89-1c07dd162b3c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:01:37,754::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:01:37,757::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:01:37,762::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:01:37,768::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:01:37,773::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:01:37,776::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:01:37,780::task::990::TaskManager.Task::(_decref) Task=`30ba920e-0405-4d66-9c89-1c07dd162b3c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:01:37,801::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:01:45,151::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000707437 s, 704 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:01:45,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 18.4799 s, 55.4 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:01:47,818::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-13::DEBUG::2014-08-21 12:01:47,820::task::595::TaskManager.Task::(_updateState) Task=`b35a1840-2ea5-473b-8d4f-e7a2430ca91f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:01:47,820::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:01:47,821::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:01:47,821::task::1185::TaskManager.Task::(prepare) Task=`b35a1840-2ea5-473b-8d4f-e7a2430ca91f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:01:47,822::task::595::TaskManager.Task::(_updateState) Task=`b35a1840-2ea5-473b-8d4f-e7a2430ca91f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:01:47,822::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:01:47,823::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:01:47,823::task::990::TaskManager.Task::(_decref) Task=`b35a1840-2ea5-473b-8d4f-e7a2430ca91f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:01:47,828::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 12:01:47,829::task::595::TaskManager.Task::(_updateState) Task=`1181ae13-40e6-49e4-a07b-23f4f352d109`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:01:47,829::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:01:47,831::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5e6c02db-6065-4b09-9d9c-2e5c55501587`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:01:47,831::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:01:47,832::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:01:47,832::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5e6c02db-6065-4b09-9d9c-2e5c55501587`::Granted request
>Thread-34::DEBUG::2014-08-21 12:01:47,833::task::827::TaskManager.Task::(resourceAcquired) Task=`1181ae13-40e6-49e4-a07b-23f4f352d109`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:01:47,833::task::990::TaskManager.Task::(_decref) Task=`1181ae13-40e6-49e4-a07b-23f4f352d109`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:01:47,841::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:47,841::task::1185::TaskManager.Task::(prepare) Task=`1181ae13-40e6-49e4-a07b-23f4f352d109`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:47,842::task::595::TaskManager.Task::(_updateState) Task=`1181ae13-40e6-49e4-a07b-23f4f352d109`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:01:47,842::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:01:47,843::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:01:47,843::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:01:47,844::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:01:47,844::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:01:47,844::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:01:47,845::task::990::TaskManager.Task::(_decref) Task=`1181ae13-40e6-49e4-a07b-23f4f352d109`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:01:47,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:01:48,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128528 s, 8.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:01:48,207::task::595::TaskManager.Task::(_updateState) Task=`8bc22c44-fdf1-43fc-bec6-75166d50168b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:01:48,207::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:01:48,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707437', 'lastCheck': '3.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:01:48,208::task::1185::TaskManager.Task::(prepare) Task=`8bc22c44-fdf1-43fc-bec6-75166d50168b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707437', 'lastCheck': '3.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:01:48,208::task::595::TaskManager.Task::(_updateState) Task=`8bc22c44-fdf1-43fc-bec6-75166d50168b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:01:48,209::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:01:48,209::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:01:48,209::task::990::TaskManager.Task::(_decref) Task=`8bc22c44-fdf1-43fc-bec6-75166d50168b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:01:50,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:01:50,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.401887 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:01:52,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:01:52,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561397 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:01:54,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:01:55,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102667 s, 10.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:01:55,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:01:55,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000658504 s, 756 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:01:57,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:01:58,476::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-26::DEBUG::2014-08-21 12:01:58,623::task::595::TaskManager.Task::(_updateState) Task=`ab6bf998-0bdd-4947-b4fd-a32672c1cab0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:01:58,632::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:01:58,637::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:01:58,653::task::1185::TaskManager.Task::(prepare) Task=`ab6bf998-0bdd-4947-b4fd-a32672c1cab0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:01:58,655::task::595::TaskManager.Task::(_updateState) Task=`ab6bf998-0bdd-4947-b4fd-a32672c1cab0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:01:58,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:01:58,727::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:01:58,731::task::990::TaskManager.Task::(_decref) Task=`ab6bf998-0bdd-4947-b4fd-a32672c1cab0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:01:58,782::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-34::DEBUG::2014-08-21 12:01:58,783::task::595::TaskManager.Task::(_updateState) Task=`289d7be9-7996-43da-8185-76b45198d3af`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:01:58,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:01:59,087::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`847ed548-65e8-46b2-bc6f-064bec2a564c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:01:59,088::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:01:59,088::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:01:59,089::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`847ed548-65e8-46b2-bc6f-064bec2a564c`::Granted request
>Thread-34::DEBUG::2014-08-21 12:01:59,090::task::827::TaskManager.Task::(resourceAcquired) Task=`289d7be9-7996-43da-8185-76b45198d3af`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:01:59,090::task::990::TaskManager.Task::(_decref) Task=`289d7be9-7996-43da-8185-76b45198d3af`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:01:59,108::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:59,108::task::1185::TaskManager.Task::(prepare) Task=`289d7be9-7996-43da-8185-76b45198d3af`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:01:59,109::task::595::TaskManager.Task::(_updateState) Task=`289d7be9-7996-43da-8185-76b45198d3af`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:01:59,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:01:59,110::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:01:59,122::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:01:59,127::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:01:59,128::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:01:59,129::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:01:59,129::task::990::TaskManager.Task::(_decref) Task=`289d7be9-7996-43da-8185-76b45198d3af`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:01:59,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.21635 s, 462 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:01,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:02,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.183089 s, 5.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:04,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:02:07,073::task::595::TaskManager.Task::(_updateState) Task=`31651f08-41af-4b56-8173-4f4843851818`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:02:07,249::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:02:07,310::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658504', 'lastCheck': '12.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:02:07,311::task::1185::TaskManager.Task::(prepare) Task=`31651f08-41af-4b56-8173-4f4843851818`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658504', 'lastCheck': '12.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:02:07,327::task::595::TaskManager.Task::(_updateState) Task=`31651f08-41af-4b56-8173-4f4843851818`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:02:07,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:02:07,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:02:07,550::task::990::TaskManager.Task::(_decref) Task=`31651f08-41af-4b56-8173-4f4843851818`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:02:10,294::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-13::DEBUG::2014-08-21 12:02:10,326::task::595::TaskManager.Task::(_updateState) Task=`46f8adfc-6626-4229-99d1-070d85925f1a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:02:10,327::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:02:10,328::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:02:10,336::task::1185::TaskManager.Task::(prepare) Task=`46f8adfc-6626-4229-99d1-070d85925f1a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:02:10,336::task::595::TaskManager.Task::(_updateState) Task=`46f8adfc-6626-4229-99d1-070d85925f1a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:02:10,344::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:02:10,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:02:10,358::task::990::TaskManager.Task::(_decref) Task=`46f8adfc-6626-4229-99d1-070d85925f1a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:02:10,960::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc930e]
>Thread-34::DEBUG::2014-08-21 12:02:11,006::task::595::TaskManager.Task::(_updateState) Task=`b1685944-ab24-4d75-9d38-7176a5671ad2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:02:11,007::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:02:11,279::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8d039072-e163-4d42-bbbf-0e86c07cdbc0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:02:11,279::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:02:11,494::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:02:13,829::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8d039072-e163-4d42-bbbf-0e86c07cdbc0`::Granted request
>Thread-15::DEBUG::2014-08-21 12:02:13,891::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:02:13,986::task::827::TaskManager.Task::(resourceAcquired) Task=`b1685944-ab24-4d75-9d38-7176a5671ad2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-15::DEBUG::2014-08-21 12:02:14,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00658308 s, 75.6 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:02:14,691::task::990::TaskManager.Task::(_decref) Task=`b1685944-ab24-4d75-9d38-7176a5671ad2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:02:14,726::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:14,727::task::1185::TaskManager.Task::(prepare) Task=`b1685944-ab24-4d75-9d38-7176a5671ad2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:14,730::task::595::TaskManager.Task::(_updateState) Task=`b1685944-ab24-4d75-9d38-7176a5671ad2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:02:14,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:02:14,731::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:02:14,732::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:02:14,740::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:02:14,740::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:02:14,741::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:02:14,742::task::990::TaskManager.Task::(_decref) Task=`b1685944-ab24-4d75-9d38-7176a5671ad2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:02:15,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.1673 s, 101 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:19,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:20,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.629176 s, 1.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:23,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:02:26,340::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-26::DEBUG::2014-08-21 12:02:26,341::task::595::TaskManager.Task::(_updateState) Task=`291e661e-edce-4e01-8fd4-fcc197d6f3ce`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:02:26,341::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:02:26,342::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:02:26,342::task::1185::TaskManager.Task::(prepare) Task=`291e661e-edce-4e01-8fd4-fcc197d6f3ce`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:02:26,342::task::595::TaskManager.Task::(_updateState) Task=`291e661e-edce-4e01-8fd4-fcc197d6f3ce`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:02:26,417::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:02:26,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:02:26,586::task::990::TaskManager.Task::(_decref) Task=`291e661e-edce-4e01-8fd4-fcc197d6f3ce`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:02:26,741::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [34a04ed]
>Thread-34::DEBUG::2014-08-21 12:02:26,818::task::595::TaskManager.Task::(_updateState) Task=`de870491-d34e-4245-abca-eeb018b4837c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:02:26,819::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:02:26,820::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`67128e1f-2ed2-4518-9d4b-d991721d199e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:02:26,821::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:02:26,821::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:02:26,822::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`67128e1f-2ed2-4518-9d4b-d991721d199e`::Granted request
>Thread-34::DEBUG::2014-08-21 12:02:26,918::task::827::TaskManager.Task::(resourceAcquired) Task=`de870491-d34e-4245-abca-eeb018b4837c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:02:26,932::task::990::TaskManager.Task::(_decref) Task=`de870491-d34e-4245-abca-eeb018b4837c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:02:27,001::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:27,002::task::1185::TaskManager.Task::(prepare) Task=`de870491-d34e-4245-abca-eeb018b4837c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:27,002::task::595::TaskManager.Task::(_updateState) Task=`de870491-d34e-4245-abca-eeb018b4837c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:02:27,003::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:02:27,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:02:27,004::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:02:27,010::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:02:27,011::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:02:27,011::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:02:27,012::task::990::TaskManager.Task::(_decref) Task=`de870491-d34e-4245-abca-eeb018b4837c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:02:27,467::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:02:27,769::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000834482 s, 597 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:28,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.13981 s, 479 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:30,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:31,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.807866 s, 1.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:02:32,626::task::595::TaskManager.Task::(_updateState) Task=`54439e44-89cc-429c-b41e-b87e1dd6da4f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:02:32,628::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:02:32,628::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000834482', 'lastCheck': '4.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:02:32,629::task::1185::TaskManager.Task::(prepare) Task=`54439e44-89cc-429c-b41e-b87e1dd6da4f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000834482', 'lastCheck': '4.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:02:32,679::task::595::TaskManager.Task::(_updateState) Task=`54439e44-89cc-429c-b41e-b87e1dd6da4f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:02:32,757::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:02:32,757::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:02:32,757::task::990::TaskManager.Task::(_decref) Task=`54439e44-89cc-429c-b41e-b87e1dd6da4f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:02:33,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:34,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.14803 s, 6.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:36,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:36,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.054463 s, 18.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:02:37,155::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-26::DEBUG::2014-08-21 12:02:37,156::task::595::TaskManager.Task::(_updateState) Task=`15c10c40-51ca-4012-863e-932f28365d68`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:02:37,157::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:02:37,157::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:02:37,158::task::1185::TaskManager.Task::(prepare) Task=`15c10c40-51ca-4012-863e-932f28365d68`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:02:37,158::task::595::TaskManager.Task::(_updateState) Task=`15c10c40-51ca-4012-863e-932f28365d68`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:02:37,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:02:37,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:02:37,158::task::990::TaskManager.Task::(_decref) Task=`15c10c40-51ca-4012-863e-932f28365d68`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:02:37,163::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 12:02:37,163::task::595::TaskManager.Task::(_updateState) Task=`c22ab02a-b87b-4cf9-ad97-fa8f46c4a3b7`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:02:37,163::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:02:37,164::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3faed180-e23c-4562-8e2e-55491dbfb9b4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:02:37,165::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:02:37,165::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:02:37,165::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3faed180-e23c-4562-8e2e-55491dbfb9b4`::Granted request
>Thread-34::DEBUG::2014-08-21 12:02:37,166::task::827::TaskManager.Task::(resourceAcquired) Task=`c22ab02a-b87b-4cf9-ad97-fa8f46c4a3b7`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:02:37,166::task::990::TaskManager.Task::(_decref) Task=`c22ab02a-b87b-4cf9-ad97-fa8f46c4a3b7`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:02:37,170::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:37,170::task::1185::TaskManager.Task::(prepare) Task=`c22ab02a-b87b-4cf9-ad97-fa8f46c4a3b7`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:37,170::task::595::TaskManager.Task::(_updateState) Task=`c22ab02a-b87b-4cf9-ad97-fa8f46c4a3b7`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:02:37,170::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:02:37,171::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:02:37,171::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:02:37,171::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:02:37,171::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:02:37,172::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:02:37,172::task::990::TaskManager.Task::(_decref) Task=`c22ab02a-b87b-4cf9-ad97-fa8f46c4a3b7`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:02:38,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:02:38,030::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000775927 s, 642 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:38,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:38,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0603969 s, 17.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:40,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:40,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0674446 s, 15.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:42,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:42,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0932452 s, 11.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:44,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:45,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0874317 s, 11.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:47,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:02:47,223::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-26::DEBUG::2014-08-21 12:02:47,225::task::595::TaskManager.Task::(_updateState) Task=`7c9dd3fb-fceb-440d-afe1-aa09b6a30f87`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:02:47,226::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:02:47,227::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:02:47,227::task::1185::TaskManager.Task::(prepare) Task=`7c9dd3fb-fceb-440d-afe1-aa09b6a30f87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:02:47,228::task::595::TaskManager.Task::(_updateState) Task=`7c9dd3fb-fceb-440d-afe1-aa09b6a30f87`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:02:47,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:02:47,229::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:02:47,229::task::990::TaskManager.Task::(_decref) Task=`7c9dd3fb-fceb-440d-afe1-aa09b6a30f87`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:02:47,256::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 12:02:47,258::task::595::TaskManager.Task::(_updateState) Task=`96eae030-8aa6-415a-bd86-086f0ed9d2cd`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:02:47,273::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:02:47,276::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ad046a54-debc-4830-a927-fb344f1f2e0f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:02:47,277::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:02:47,278::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:02:47,278::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ad046a54-debc-4830-a927-fb344f1f2e0f`::Granted request
>Thread-34::DEBUG::2014-08-21 12:02:47,280::task::827::TaskManager.Task::(resourceAcquired) Task=`96eae030-8aa6-415a-bd86-086f0ed9d2cd`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:02:47,281::task::990::TaskManager.Task::(_decref) Task=`96eae030-8aa6-415a-bd86-086f0ed9d2cd`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:02:47,465::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:47,465::task::1185::TaskManager.Task::(prepare) Task=`96eae030-8aa6-415a-bd86-086f0ed9d2cd`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:47,466::task::595::TaskManager.Task::(_updateState) Task=`96eae030-8aa6-415a-bd86-086f0ed9d2cd`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:02:47,466::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:02:47,466::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:02:47,904::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:02:47,905::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:02:47,905::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:02:47,986::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-26::DEBUG::2014-08-21 12:02:47,988::task::595::TaskManager.Task::(_updateState) Task=`c7b616ce-f956-4849-96d4-7dd19acf0626`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:02:47,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:02:47,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775927', 'lastCheck': '9.9', 'valid': True}}
>Thread-34::DEBUG::2014-08-21 12:02:47,992::task::990::TaskManager.Task::(_decref) Task=`96eae030-8aa6-415a-bd86-086f0ed9d2cd`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:02:47,993::task::1185::TaskManager.Task::(prepare) Task=`c7b616ce-f956-4849-96d4-7dd19acf0626`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775927', 'lastCheck': '9.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:02:47,994::task::595::TaskManager.Task::(_updateState) Task=`c7b616ce-f956-4849-96d4-7dd19acf0626`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:02:47,995::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:02:47,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:02:47,998::task::990::TaskManager.Task::(_decref) Task=`c7b616ce-f956-4849-96d4-7dd19acf0626`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:02:48,070::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:02:48,112::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000560955 s, 888 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:48,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.082 s, 946 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:50,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:50,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100182 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:52,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:53,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.340625 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:55,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:55,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0553614 s, 18.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:57,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:57,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0767296 s, 13.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:02:58,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-26::DEBUG::2014-08-21 12:02:58,038::task::595::TaskManager.Task::(_updateState) Task=`1ba35f67-b12a-4eb1-bdea-c861045c3df6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:02:58,038::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:02:58,039::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:02:58,040::task::1185::TaskManager.Task::(prepare) Task=`1ba35f67-b12a-4eb1-bdea-c861045c3df6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:02:58,040::task::595::TaskManager.Task::(_updateState) Task=`1ba35f67-b12a-4eb1-bdea-c861045c3df6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:02:58,040::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:02:58,041::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:02:58,041::task::990::TaskManager.Task::(_decref) Task=`1ba35f67-b12a-4eb1-bdea-c861045c3df6`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:02:58,048::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-34::DEBUG::2014-08-21 12:02:58,049::task::595::TaskManager.Task::(_updateState) Task=`823fd832-1a5e-435a-b1dd-88c86fdaf946`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:02:58,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:02:58,050::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e9c74cd3-6ee7-4d3c-846a-04178c74a400`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:02:58,051::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:02:58,051::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:02:58,052::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e9c74cd3-6ee7-4d3c-846a-04178c74a400`::Granted request
>Thread-34::DEBUG::2014-08-21 12:02:58,053::task::827::TaskManager.Task::(resourceAcquired) Task=`823fd832-1a5e-435a-b1dd-88c86fdaf946`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:02:58,053::task::990::TaskManager.Task::(_decref) Task=`823fd832-1a5e-435a-b1dd-88c86fdaf946`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:02:58,066::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:58,066::task::1185::TaskManager.Task::(prepare) Task=`823fd832-1a5e-435a-b1dd-88c86fdaf946`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:02:58,067::task::595::TaskManager.Task::(_updateState) Task=`823fd832-1a5e-435a-b1dd-88c86fdaf946`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:02:58,067::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:02:58,067::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:02:58,070::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:02:58,071::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:02:58,071::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:02:58,071::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:02:58,072::task::990::TaskManager.Task::(_decref) Task=`823fd832-1a5e-435a-b1dd-88c86fdaf946`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:02:58,148::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:02:58,157::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:02:58,162::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 12:02:58,196::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 12:02:58,278::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 12:02:58,288::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 12:02:58,289::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 12:02:58,797::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:02:58,879::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00390947 s, 127 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:02:59,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:02:59,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.171536 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:01,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:02,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.061099 s, 16.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:04,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:03:05,368::task::595::TaskManager.Task::(_updateState) Task=`a79be7e9-35e1-47cf-92b5-cb1f0a0aeb13`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:03:05,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:03:05,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00390947', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:03:05,400::task::1185::TaskManager.Task::(prepare) Task=`a79be7e9-35e1-47cf-92b5-cb1f0a0aeb13`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00390947', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:03:05,400::task::595::TaskManager.Task::(_updateState) Task=`a79be7e9-35e1-47cf-92b5-cb1f0a0aeb13`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:03:05,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:03:05,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:03:05,401::task::990::TaskManager.Task::(_decref) Task=`a79be7e9-35e1-47cf-92b5-cb1f0a0aeb13`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:03:05,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124966 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:07,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:07,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.157234 s, 6.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:03:13,741::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-26::DEBUG::2014-08-21 12:03:13,744::task::595::TaskManager.Task::(_updateState) Task=`0e9b3790-43ab-44a6-b032-470c52738b76`::moving from state init -> state preparing
>Dummy-33::DEBUG::2014-08-21 12:03:13,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::INFO::2014-08-21 12:03:13,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:03:16,041::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:03:16,042::task::1185::TaskManager.Task::(prepare) Task=`0e9b3790-43ab-44a6-b032-470c52738b76`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:03:16,043::task::595::TaskManager.Task::(_updateState) Task=`0e9b3790-43ab-44a6-b032-470c52738b76`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:03:16,044::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:03:16,045::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:03:16,045::task::990::TaskManager.Task::(_decref) Task=`0e9b3790-43ab-44a6-b032-470c52738b76`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:03:16,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:03:16,859::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-34::DEBUG::2014-08-21 12:03:16,902::task::595::TaskManager.Task::(_updateState) Task=`1d590fb4-09ee-4101-a03c-e7b389c32bef`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:03:16,903::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:03:16,904::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`df53e51f-eb46-4b18-88c2-c2fbe1acbb41`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:03:16,905::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:03:16,906::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:03:16,906::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`df53e51f-eb46-4b18-88c2-c2fbe1acbb41`::Granted request
>Thread-34::DEBUG::2014-08-21 12:03:16,907::task::827::TaskManager.Task::(resourceAcquired) Task=`1d590fb4-09ee-4101-a03c-e7b389c32bef`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:03:16,908::task::990::TaskManager.Task::(_decref) Task=`1d590fb4-09ee-4101-a03c-e7b389c32bef`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:03:16,916::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:16,917::task::1185::TaskManager.Task::(prepare) Task=`1d590fb4-09ee-4101-a03c-e7b389c32bef`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:16,922::task::595::TaskManager.Task::(_updateState) Task=`1d590fb4-09ee-4101-a03c-e7b389c32bef`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:03:16,922::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:03:16,922::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:03:16,923::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:03:16,924::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:03:16,924::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:03:16,925::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:03:16,925::task::990::TaskManager.Task::(_decref) Task=`1d590fb4-09ee-4101-a03c-e7b389c32bef`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:03:17,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0013088 s, 381 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:17,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.687389 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:19,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:19,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0722896 s, 14.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:21,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:21,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0519697 s, 19.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:24,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:24,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0751692 s, 13.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:26,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:26,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100026 s, 10.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:03:27,049::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-26::DEBUG::2014-08-21 12:03:27,050::task::595::TaskManager.Task::(_updateState) Task=`5094f769-4b87-44be-8751-8d23073362c4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:03:27,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:03:27,052::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:03:27,052::task::1185::TaskManager.Task::(prepare) Task=`5094f769-4b87-44be-8751-8d23073362c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:03:27,052::task::595::TaskManager.Task::(_updateState) Task=`5094f769-4b87-44be-8751-8d23073362c4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:03:27,052::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:03:27,052::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:03:27,053::task::990::TaskManager.Task::(_decref) Task=`5094f769-4b87-44be-8751-8d23073362c4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:03:27,058::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-34::DEBUG::2014-08-21 12:03:27,058::task::595::TaskManager.Task::(_updateState) Task=`46cd2079-273c-4fb9-9031-90fb3d414507`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:03:27,059::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:03:27,059::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`185ebbee-1203-4368-86a1-632471db5630`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:03:27,060::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:03:27,060::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:03:27,060::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`185ebbee-1203-4368-86a1-632471db5630`::Granted request
>Thread-34::DEBUG::2014-08-21 12:03:27,061::task::827::TaskManager.Task::(resourceAcquired) Task=`46cd2079-273c-4fb9-9031-90fb3d414507`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:03:27,061::task::990::TaskManager.Task::(_decref) Task=`46cd2079-273c-4fb9-9031-90fb3d414507`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:03:27,065::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968350208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:27,065::task::1185::TaskManager.Task::(prepare) Task=`46cd2079-273c-4fb9-9031-90fb3d414507`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968350208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:27,066::task::595::TaskManager.Task::(_updateState) Task=`46cd2079-273c-4fb9-9031-90fb3d414507`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:03:27,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:03:27,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:03:27,066::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:03:27,066::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:03:27,067::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:03:27,067::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:03:27,067::task::990::TaskManager.Task::(_decref) Task=`46cd2079-273c-4fb9-9031-90fb3d414507`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:03:27,311::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:03:27,328::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000752965 s, 661 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:28,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:03:30,255::task::595::TaskManager.Task::(_updateState) Task=`4616792b-42f3-495b-b282-91007bc8fb23`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:03:30,643::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:03:30,644::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752965', 'lastCheck': '3.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:03:30,644::task::1185::TaskManager.Task::(prepare) Task=`4616792b-42f3-495b-b282-91007bc8fb23`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752965', 'lastCheck': '3.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:03:30,645::task::595::TaskManager.Task::(_updateState) Task=`4616792b-42f3-495b-b282-91007bc8fb23`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:03:30,645::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:03:30,645::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:03:30,646::task::990::TaskManager.Task::(_decref) Task=`4616792b-42f3-495b-b282-91007bc8fb23`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:03:31,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.19098 s, 321 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:33,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:33,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039899 s, 25.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:35,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:03:38,200::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-26::DEBUG::2014-08-21 12:03:38,206::task::595::TaskManager.Task::(_updateState) Task=`071364d3-b61f-4b69-af3a-cf55d6d93f30`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:03:38,211::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:03:38,217::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:03:38,218::task::1185::TaskManager.Task::(prepare) Task=`071364d3-b61f-4b69-af3a-cf55d6d93f30`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:03:38,220::task::595::TaskManager.Task::(_updateState) Task=`071364d3-b61f-4b69-af3a-cf55d6d93f30`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:03:38,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:03:38,225::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:03:38,228::task::990::TaskManager.Task::(_decref) Task=`071364d3-b61f-4b69-af3a-cf55d6d93f30`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:03:38,237::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-34::DEBUG::2014-08-21 12:03:38,239::task::595::TaskManager.Task::(_updateState) Task=`c85c90a9-2901-44ed-9ead-4d1d24f19c0c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:03:38,240::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:03:38,243::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`16eb8d1e-5272-4a61-b127-f93e93fe9857`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:03:38,244::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:03:38,246::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:03:38,247::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`16eb8d1e-5272-4a61-b127-f93e93fe9857`::Granted request
>Thread-34::DEBUG::2014-08-21 12:03:38,249::task::827::TaskManager.Task::(resourceAcquired) Task=`c85c90a9-2901-44ed-9ead-4d1d24f19c0c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:03:38,250::task::990::TaskManager.Task::(_decref) Task=`c85c90a9-2901-44ed-9ead-4d1d24f19c0c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:03:38,270::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:38,270::task::1185::TaskManager.Task::(prepare) Task=`c85c90a9-2901-44ed-9ead-4d1d24f19c0c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:38,272::task::595::TaskManager.Task::(_updateState) Task=`c85c90a9-2901-44ed-9ead-4d1d24f19c0c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:03:38,273::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:03:38,275::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:03:38,276::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-15::DEBUG::2014-08-21 12:03:38,277::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:03:38,289::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:03:38,290::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:03:38,291::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:03:38,291::task::990::TaskManager.Task::(_decref) Task=`c85c90a9-2901-44ed-9ead-4d1d24f19c0c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:03:38,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.65142 s, 620 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:03:38,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0870768 s, 5.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:40,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:40,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.126782 s, 8.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:42,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:44,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.35618 s, 755 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:46,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:46,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.15443 s, 6.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:03:47,398::task::595::TaskManager.Task::(_updateState) Task=`c603613d-15fc-45ba-94ee-b6fa624dee2b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:03:47,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:03:47,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0870768', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:03:47,400::task::1185::TaskManager.Task::(prepare) Task=`c603613d-15fc-45ba-94ee-b6fa624dee2b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0870768', 'lastCheck': '9.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:03:47,400::task::595::TaskManager.Task::(_updateState) Task=`c603613d-15fc-45ba-94ee-b6fa624dee2b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:03:47,400::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:03:47,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:03:47,401::task::990::TaskManager.Task::(_decref) Task=`c603613d-15fc-45ba-94ee-b6fa624dee2b`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:03:48,317::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-26::DEBUG::2014-08-21 12:03:48,319::task::595::TaskManager.Task::(_updateState) Task=`94fa28e1-31f7-452a-9279-b78e7e66d3ab`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:03:48,319::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:03:48,320::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:03:48,321::task::1185::TaskManager.Task::(prepare) Task=`94fa28e1-31f7-452a-9279-b78e7e66d3ab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:03:48,321::task::595::TaskManager.Task::(_updateState) Task=`94fa28e1-31f7-452a-9279-b78e7e66d3ab`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:03:48,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:03:48,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:03:48,322::task::990::TaskManager.Task::(_decref) Task=`94fa28e1-31f7-452a-9279-b78e7e66d3ab`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:03:48,328::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-34::DEBUG::2014-08-21 12:03:48,329::task::595::TaskManager.Task::(_updateState) Task=`a7d56782-f5f8-4899-b581-26128b1ba524`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:03:48,329::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:03:48,330::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`01fab2ea-eb5c-469f-95ed-554125d53744`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:03:48,330::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:03:48,331::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:03:48,331::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`01fab2ea-eb5c-469f-95ed-554125d53744`::Granted request
>Thread-34::DEBUG::2014-08-21 12:03:48,333::task::827::TaskManager.Task::(resourceAcquired) Task=`a7d56782-f5f8-4899-b581-26128b1ba524`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:03:48,333::task::990::TaskManager.Task::(_decref) Task=`a7d56782-f5f8-4899-b581-26128b1ba524`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:03:48,341::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:48,341::task::1185::TaskManager.Task::(prepare) Task=`a7d56782-f5f8-4899-b581-26128b1ba524`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:48,342::task::595::TaskManager.Task::(_updateState) Task=`a7d56782-f5f8-4899-b581-26128b1ba524`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:03:48,342::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:03:48,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:03:48,343::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:03:48,344::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:03:48,344::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:03:48,344::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:03:48,345::task::990::TaskManager.Task::(_decref) Task=`a7d56782-f5f8-4899-b581-26128b1ba524`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:03:48,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:03:48,511::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:03:48,543::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00233791 s, 213 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:48,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.196276 s, 5.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:50,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:50,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537519 s, 19.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:52,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:53,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.188634 s, 5.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:55,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:03:55,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.330746 s, 3.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:03:57,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:03:58,620::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-13::DEBUG::2014-08-21 12:03:58,621::task::595::TaskManager.Task::(_updateState) Task=`dd752eee-9685-4995-a255-815a560b9dcd`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:03:58,622::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:03:58,622::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:03:58,622::task::1185::TaskManager.Task::(prepare) Task=`dd752eee-9685-4995-a255-815a560b9dcd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:03:58,623::task::595::TaskManager.Task::(_updateState) Task=`dd752eee-9685-4995-a255-815a560b9dcd`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:03:58,623::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:03:58,623::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:03:58,623::task::990::TaskManager.Task::(_decref) Task=`dd752eee-9685-4995-a255-815a560b9dcd`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:03:59,213::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-34::DEBUG::2014-08-21 12:03:59,214::task::595::TaskManager.Task::(_updateState) Task=`6d1481a9-9e2d-4fbc-acb3-a6c3a96e5f5d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:03:59,214::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:03:59,215::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`37299a75-9357-415d-baef-c2fb8d948b14`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:03:59,215::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:03:59,216::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:03:59,216::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`37299a75-9357-415d-baef-c2fb8d948b14`::Granted request
>Thread-34::DEBUG::2014-08-21 12:03:59,217::task::827::TaskManager.Task::(resourceAcquired) Task=`6d1481a9-9e2d-4fbc-acb3-a6c3a96e5f5d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:03:59,217::task::990::TaskManager.Task::(_decref) Task=`6d1481a9-9e2d-4fbc-acb3-a6c3a96e5f5d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:03:59,224::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:59,225::task::1185::TaskManager.Task::(prepare) Task=`6d1481a9-9e2d-4fbc-acb3-a6c3a96e5f5d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:03:59,225::task::595::TaskManager.Task::(_updateState) Task=`6d1481a9-9e2d-4fbc-acb3-a6c3a96e5f5d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:03:59,225::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:03:59,226::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:03:59,226::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:03:59,227::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:03:59,227::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:03:59,227::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:03:59,228::task::990::TaskManager.Task::(_decref) Task=`6d1481a9-9e2d-4fbc-acb3-a6c3a96e5f5d`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:04:01,476::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:04:02,177::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0379308 s, 13.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:04,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.39969 s, 160 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:04:05,054::task::595::TaskManager.Task::(_updateState) Task=`eac7f198-a8d5-4581-9744-1398d63a38c6`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:04:05,055::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:04:05,056::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0379308', 'lastCheck': '0.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:04:05,056::task::1185::TaskManager.Task::(prepare) Task=`eac7f198-a8d5-4581-9744-1398d63a38c6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0379308', 'lastCheck': '0.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:04:05,057::task::595::TaskManager.Task::(_updateState) Task=`eac7f198-a8d5-4581-9744-1398d63a38c6`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:04:05,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:04:05,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:04:05,058::task::990::TaskManager.Task::(_decref) Task=`eac7f198-a8d5-4581-9744-1398d63a38c6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:04:06,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:06,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.261281 s, 3.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:08,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:04:11,114::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-13::DEBUG::2014-08-21 12:04:11,116::task::595::TaskManager.Task::(_updateState) Task=`fa0bae33-b27c-4ec6-8c1c-0301f861575e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:04:11,117::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:04:11,121::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:11,144::task::1185::TaskManager.Task::(prepare) Task=`fa0bae33-b27c-4ec6-8c1c-0301f861575e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:11,145::task::595::TaskManager.Task::(_updateState) Task=`fa0bae33-b27c-4ec6-8c1c-0301f861575e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:04:11,145::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:04:11,145::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:04:11,146::task::990::TaskManager.Task::(_decref) Task=`fa0bae33-b27c-4ec6-8c1c-0301f861575e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:04:11,773::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-34::DEBUG::2014-08-21 12:04:11,775::task::595::TaskManager.Task::(_updateState) Task=`e281c8d3-d44b-432f-8108-a630c24c3e60`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:04:11,775::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:04:11,777::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7d687443-88f7-443a-8f15-17443ab08779`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:04:11,777::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:04:11,778::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:04:11,779::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7d687443-88f7-443a-8f15-17443ab08779`::Granted request
>Thread-34::DEBUG::2014-08-21 12:04:11,780::task::827::TaskManager.Task::(resourceAcquired) Task=`e281c8d3-d44b-432f-8108-a630c24c3e60`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:04:11,781::task::990::TaskManager.Task::(_decref) Task=`e281c8d3-d44b-432f-8108-a630c24c3e60`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:04:11,818::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:11,819::task::1185::TaskManager.Task::(prepare) Task=`e281c8d3-d44b-432f-8108-a630c24c3e60`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:11,819::task::595::TaskManager.Task::(_updateState) Task=`e281c8d3-d44b-432f-8108-a630c24c3e60`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:04:11,827::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:04:11,828::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:04:11,848::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:04:11,857::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:04:11,858::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:04:11,858::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:04:11,859::task::990::TaskManager.Task::(_decref) Task=`e281c8d3-d44b-432f-8108-a630c24c3e60`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:04:11,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.04708 s, 336 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:13,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:14,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554101 s, 18.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:04:14,290::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:04:14,305::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000628364 s, 793 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:16,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:16,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.168219 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:18,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:18,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0831833 s, 12.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:04:20,333::task::595::TaskManager.Task::(_updateState) Task=`6570b2d0-fe30-497f-a6e5-96ba429e05ab`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:04:20,333::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:04:20,334::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628364', 'lastCheck': '6.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:04:20,335::task::1185::TaskManager.Task::(prepare) Task=`6570b2d0-fe30-497f-a6e5-96ba429e05ab`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628364', 'lastCheck': '6.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:04:20,335::task::595::TaskManager.Task::(_updateState) Task=`6570b2d0-fe30-497f-a6e5-96ba429e05ab`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:04:20,335::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:04:20,336::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:04:20,336::task::990::TaskManager.Task::(_decref) Task=`6570b2d0-fe30-497f-a6e5-96ba429e05ab`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:04:20,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:21,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0995089 s, 10.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:04:21,905::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-13::DEBUG::2014-08-21 12:04:21,910::task::595::TaskManager.Task::(_updateState) Task=`658406bf-539c-4d17-8dec-9045c5e0843d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:04:21,911::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:04:21,970::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:21,995::task::1185::TaskManager.Task::(prepare) Task=`658406bf-539c-4d17-8dec-9045c5e0843d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:21,996::task::595::TaskManager.Task::(_updateState) Task=`658406bf-539c-4d17-8dec-9045c5e0843d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:04:21,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:04:21,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:04:21,997::task::990::TaskManager.Task::(_decref) Task=`658406bf-539c-4d17-8dec-9045c5e0843d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:04:22,525::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-34::DEBUG::2014-08-21 12:04:22,526::task::595::TaskManager.Task::(_updateState) Task=`60e1a745-7543-40ca-a92b-a9e6a5aa8348`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:04:22,529::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:04:22,530::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d571ddc2-1e12-48f4-b535-f3b8c9634407`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:04:22,530::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:04:22,531::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:04:22,531::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d571ddc2-1e12-48f4-b535-f3b8c9634407`::Granted request
>Thread-34::DEBUG::2014-08-21 12:04:22,535::task::827::TaskManager.Task::(resourceAcquired) Task=`60e1a745-7543-40ca-a92b-a9e6a5aa8348`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:04:22,536::task::990::TaskManager.Task::(_decref) Task=`60e1a745-7543-40ca-a92b-a9e6a5aa8348`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:04:22,549::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:22,550::task::1185::TaskManager.Task::(prepare) Task=`60e1a745-7543-40ca-a92b-a9e6a5aa8348`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:22,550::task::595::TaskManager.Task::(_updateState) Task=`60e1a745-7543-40ca-a92b-a9e6a5aa8348`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:04:22,551::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:04:22,551::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:04:22,552::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:04:22,553::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:04:22,553::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:04:22,553::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:04:22,554::task::990::TaskManager.Task::(_decref) Task=`60e1a745-7543-40ca-a92b-a9e6a5aa8348`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:04:23,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:23,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0782767 s, 13.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:04:24,351::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:04:24,382::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000483588 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:25,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:25,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.165972 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:27,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:28,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.417617 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:30,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:31,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.570011 s, 1.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:04:32,576::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-13::DEBUG::2014-08-21 12:04:32,578::task::595::TaskManager.Task::(_updateState) Task=`30e0dd42-3f03-486e-a982-e136727109d8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:04:32,578::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:04:32,579::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:32,580::task::1185::TaskManager.Task::(prepare) Task=`30e0dd42-3f03-486e-a982-e136727109d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:32,580::task::595::TaskManager.Task::(_updateState) Task=`30e0dd42-3f03-486e-a982-e136727109d8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:04:32,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:04:32,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:04:32,582::task::990::TaskManager.Task::(_decref) Task=`30e0dd42-3f03-486e-a982-e136727109d8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:04:32,628::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-34::DEBUG::2014-08-21 12:04:32,629::task::595::TaskManager.Task::(_updateState) Task=`2f1cc151-1d14-4f0f-a178-46265cce5b63`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:04:32,629::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:04:32,630::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6b4c5db7-96be-4a37-a349-68488af6ae11`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:04:32,630::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:04:32,631::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:04:32,631::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6b4c5db7-96be-4a37-a349-68488af6ae11`::Granted request
>Thread-34::DEBUG::2014-08-21 12:04:32,632::task::827::TaskManager.Task::(resourceAcquired) Task=`2f1cc151-1d14-4f0f-a178-46265cce5b63`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:04:32,632::task::990::TaskManager.Task::(_decref) Task=`2f1cc151-1d14-4f0f-a178-46265cce5b63`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:04:32,645::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967301632', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:32,645::task::1185::TaskManager.Task::(prepare) Task=`2f1cc151-1d14-4f0f-a178-46265cce5b63`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967301632', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:32,646::task::595::TaskManager.Task::(_updateState) Task=`2f1cc151-1d14-4f0f-a178-46265cce5b63`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:04:32,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:04:32,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:04:32,647::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:04:32,647::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:04:32,648::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:04:32,648::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:04:32,648::task::990::TaskManager.Task::(_decref) Task=`2f1cc151-1d14-4f0f-a178-46265cce5b63`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:04:33,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:34,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.588929 s, 1.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:04:34,424::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:04:34,643::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00066577 s, 748 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:04:35,544::task::595::TaskManager.Task::(_updateState) Task=`64092b54-89d3-4fd5-b8c9-d709c1440977`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:04:35,544::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:04:35,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066577', 'lastCheck': '0.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:04:35,545::task::1185::TaskManager.Task::(prepare) Task=`64092b54-89d3-4fd5-b8c9-d709c1440977`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066577', 'lastCheck': '0.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:04:35,545::task::595::TaskManager.Task::(_updateState) Task=`64092b54-89d3-4fd5-b8c9-d709c1440977`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:04:35,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:04:35,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:04:35,546::task::990::TaskManager.Task::(_decref) Task=`64092b54-89d3-4fd5-b8c9-d709c1440977`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:04:36,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:36,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561991 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:38,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:42,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.923923 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:04:43,778::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-13::DEBUG::2014-08-21 12:04:43,900::task::595::TaskManager.Task::(_updateState) Task=`aee76263-9012-4815-88cc-59a7f2776734`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:04:43,917::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:04:43,928::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:43,928::task::1185::TaskManager.Task::(prepare) Task=`aee76263-9012-4815-88cc-59a7f2776734`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:43,929::task::595::TaskManager.Task::(_updateState) Task=`aee76263-9012-4815-88cc-59a7f2776734`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:04:43,939::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:04:43,945::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:04:43,945::task::990::TaskManager.Task::(_decref) Task=`aee76263-9012-4815-88cc-59a7f2776734`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:04:43,995::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [469a5562]
>Thread-34::DEBUG::2014-08-21 12:04:44,002::task::595::TaskManager.Task::(_updateState) Task=`d8068806-db7f-4c2c-86cb-48ef69063d9d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:04:44,008::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:04:44,016::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3cdf7a37-8f2d-4ca4-94c3-07e4455a0674`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:04:44,018::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:04:44,020::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:04:44,021::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3cdf7a37-8f2d-4ca4-94c3-07e4455a0674`::Granted request
>Thread-34::DEBUG::2014-08-21 12:04:44,025::task::827::TaskManager.Task::(resourceAcquired) Task=`d8068806-db7f-4c2c-86cb-48ef69063d9d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:04:44,066::task::990::TaskManager.Task::(_decref) Task=`d8068806-db7f-4c2c-86cb-48ef69063d9d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:04:44,079::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:44,081::task::1185::TaskManager.Task::(prepare) Task=`d8068806-db7f-4c2c-86cb-48ef69063d9d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:44,082::task::595::TaskManager.Task::(_updateState) Task=`d8068806-db7f-4c2c-86cb-48ef69063d9d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:04:44,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:04:44,084::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:04:44,086::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:04:44,089::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:04:44,090::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:04:44,091::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:04:44,092::task::990::TaskManager.Task::(_decref) Task=`d8068806-db7f-4c2c-86cb-48ef69063d9d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:04:44,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:04:45,793::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:04:46,138::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00981083 s, 50.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:48,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.49124 s, 293 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:52,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:53,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.322084 s, 3.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:04:54,120::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-13::DEBUG::2014-08-21 12:04:54,125::task::595::TaskManager.Task::(_updateState) Task=`e5a89bf8-f925-41d1-b20c-7e9b27675979`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:04:54,128::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:04:54,130::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:54,131::task::1185::TaskManager.Task::(prepare) Task=`e5a89bf8-f925-41d1-b20c-7e9b27675979`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:04:54,134::task::595::TaskManager.Task::(_updateState) Task=`e5a89bf8-f925-41d1-b20c-7e9b27675979`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:04:54,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:04:54,634::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:04:54,708::task::990::TaskManager.Task::(_decref) Task=`e5a89bf8-f925-41d1-b20c-7e9b27675979`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:04:54,819::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-34::DEBUG::2014-08-21 12:04:54,866::task::595::TaskManager.Task::(_updateState) Task=`670e48bb-1ad9-4d27-8a39-d1663336cfac`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:04:54,892::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:04:54,913::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b2c3e9b4-6c38-4c6b-9f23-ea687eec941a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:04:54,914::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:04:54,914::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:04:54,915::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b2c3e9b4-6c38-4c6b-9f23-ea687eec941a`::Granted request
>Thread-34::DEBUG::2014-08-21 12:04:54,915::task::827::TaskManager.Task::(resourceAcquired) Task=`670e48bb-1ad9-4d27-8a39-d1663336cfac`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:04:54,953::task::990::TaskManager.Task::(_decref) Task=`670e48bb-1ad9-4d27-8a39-d1663336cfac`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:04:54,958::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:54,958::task::1185::TaskManager.Task::(prepare) Task=`670e48bb-1ad9-4d27-8a39-d1663336cfac`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:04:54,959::task::595::TaskManager.Task::(_updateState) Task=`670e48bb-1ad9-4d27-8a39-d1663336cfac`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:04:54,959::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:04:54,959::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:04:54,959::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:04:54,960::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:04:54,960::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:04:54,960::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:04:54,960::task::990::TaskManager.Task::(_decref) Task=`670e48bb-1ad9-4d27-8a39-d1663336cfac`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:04:57,305::task::595::TaskManager.Task::(_updateState) Task=`037351e0-dbe2-4910-ac27-51bc62b61109`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:04:57,305::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:04:57,306::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00981083', 'lastCheck': '9.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:04:57,306::task::1185::TaskManager.Task::(prepare) Task=`037351e0-dbe2-4910-ac27-51bc62b61109`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00981083', 'lastCheck': '9.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:04:57,306::task::595::TaskManager.Task::(_updateState) Task=`037351e0-dbe2-4910-ac27-51bc62b61109`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:04:57,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:04:57,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:04:57,307::task::990::TaskManager.Task::(_decref) Task=`037351e0-dbe2-4910-ac27-51bc62b61109`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:04:57,815::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:04:57,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:04:58,297::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000963134 s, 517 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:04:58,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0753276 s, 13.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:00,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:01,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.240395 s, 4.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:04,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:04,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.066908 s, 15.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:05:04,973::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-13::DEBUG::2014-08-21 12:05:04,975::task::595::TaskManager.Task::(_updateState) Task=`eba3bef9-81e9-419c-bf2f-81747687ee92`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:05:04,975::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:05:04,975::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:05:04,976::task::1185::TaskManager.Task::(prepare) Task=`eba3bef9-81e9-419c-bf2f-81747687ee92`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:05:04,976::task::595::TaskManager.Task::(_updateState) Task=`eba3bef9-81e9-419c-bf2f-81747687ee92`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:05:04,976::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:05:04,976::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:05:04,977::task::990::TaskManager.Task::(_decref) Task=`eba3bef9-81e9-419c-bf2f-81747687ee92`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:05:04,981::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-34::DEBUG::2014-08-21 12:05:04,982::task::595::TaskManager.Task::(_updateState) Task=`208b86a2-17a9-42ef-80b4-1665af7f93a6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:05:04,982::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:05:04,983::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d86f0a83-b957-4004-a056-a28b4363ffc8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:05:04,983::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:05:04,983::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:05:04,983::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d86f0a83-b957-4004-a056-a28b4363ffc8`::Granted request
>Thread-34::DEBUG::2014-08-21 12:05:04,985::task::827::TaskManager.Task::(resourceAcquired) Task=`208b86a2-17a9-42ef-80b4-1665af7f93a6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:05:04,985::task::990::TaskManager.Task::(_decref) Task=`208b86a2-17a9-42ef-80b4-1665af7f93a6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:05:04,989::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968350208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:04,990::task::1185::TaskManager.Task::(prepare) Task=`208b86a2-17a9-42ef-80b4-1665af7f93a6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968350208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:04,990::task::595::TaskManager.Task::(_updateState) Task=`208b86a2-17a9-42ef-80b4-1665af7f93a6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:05:04,990::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:05:04,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:05:04,991::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:05:04,991::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:05:04,991::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:05:04,991::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:05:04,992::task::990::TaskManager.Task::(_decref) Task=`208b86a2-17a9-42ef-80b4-1665af7f93a6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:05:06,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:06,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0891334 s, 11.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:08,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:05:08,684::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:05:08,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00251337 s, 198 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:08,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.423814 s, 2.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:10,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:11,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.949322 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:05:12,814::task::595::TaskManager.Task::(_updateState) Task=`8742b72a-3c26-4c55-8290-f4957b0fe330`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:05:12,815::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:05:12,815::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00251337', 'lastCheck': '4.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:05:12,815::task::1185::TaskManager.Task::(prepare) Task=`8742b72a-3c26-4c55-8290-f4957b0fe330`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00251337', 'lastCheck': '4.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:05:12,815::task::595::TaskManager.Task::(_updateState) Task=`8742b72a-3c26-4c55-8290-f4957b0fe330`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:05:12,816::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:05:12,816::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:05:12,816::task::990::TaskManager.Task::(_decref) Task=`8742b72a-3c26-4c55-8290-f4957b0fe330`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:05:13,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:14,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.169906 s, 6.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:05:15,008::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Thread-13::DEBUG::2014-08-21 12:05:15,010::task::595::TaskManager.Task::(_updateState) Task=`2d01b9ef-10e0-4b1a-9adf-08e844babe0f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:05:15,010::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:05:15,011::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:05:15,012::task::1185::TaskManager.Task::(prepare) Task=`2d01b9ef-10e0-4b1a-9adf-08e844babe0f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:05:15,012::task::595::TaskManager.Task::(_updateState) Task=`2d01b9ef-10e0-4b1a-9adf-08e844babe0f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:05:15,012::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:05:15,013::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:05:15,013::task::990::TaskManager.Task::(_decref) Task=`2d01b9ef-10e0-4b1a-9adf-08e844babe0f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:05:15,018::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Thread-34::DEBUG::2014-08-21 12:05:15,019::task::595::TaskManager.Task::(_updateState) Task=`4da8fa0c-a3a4-422e-94e6-1d8e93e21e4c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:05:15,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:05:15,021::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cf7dc687-5dc1-4ccf-ada9-b988eff98972`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:05:15,022::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:05:15,022::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:05:15,023::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cf7dc687-5dc1-4ccf-ada9-b988eff98972`::Granted request
>Thread-34::DEBUG::2014-08-21 12:05:15,024::task::827::TaskManager.Task::(resourceAcquired) Task=`4da8fa0c-a3a4-422e-94e6-1d8e93e21e4c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:05:15,024::task::990::TaskManager.Task::(_decref) Task=`4da8fa0c-a3a4-422e-94e6-1d8e93e21e4c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:05:15,032::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:15,033::task::1185::TaskManager.Task::(prepare) Task=`4da8fa0c-a3a4-422e-94e6-1d8e93e21e4c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:15,033::task::595::TaskManager.Task::(_updateState) Task=`4da8fa0c-a3a4-422e-94e6-1d8e93e21e4c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:05:15,034::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:05:15,034::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:05:15,035::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:05:15,035::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:05:15,035::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:05:15,036::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:05:15,036::task::990::TaskManager.Task::(_decref) Task=`4da8fa0c-a3a4-422e-94e6-1d8e93e21e4c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:05:16,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:16,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0836082 s, 12.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:18,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:05:20,304::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:05:20,351::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0019441 s, 256 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:20,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.368623 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:22,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:22,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0893407 s, 11.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:05:25,576::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-13::DEBUG::2014-08-21 12:05:25,577::task::595::TaskManager.Task::(_updateState) Task=`f7f5f912-7c0f-42e6-8298-d0bf781c1b8a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:05:25,578::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:05:25,596::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:05:25,655::task::1185::TaskManager.Task::(prepare) Task=`f7f5f912-7c0f-42e6-8298-d0bf781c1b8a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:05:25,656::task::595::TaskManager.Task::(_updateState) Task=`f7f5f912-7c0f-42e6-8298-d0bf781c1b8a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:05:25,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:05:25,657::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:05:25,657::task::990::TaskManager.Task::(_decref) Task=`f7f5f912-7c0f-42e6-8298-d0bf781c1b8a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:05:25,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:05:26,035::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-34::DEBUG::2014-08-21 12:05:26,037::task::595::TaskManager.Task::(_updateState) Task=`68b250c7-4b44-4950-b86a-e4092136ff6f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:05:26,037::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:05:26,038::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0f332c56-36a5-4419-9d73-43f7912b12bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:05:26,038::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:05:26,039::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:05:26,039::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0f332c56-36a5-4419-9d73-43f7912b12bb`::Granted request
>Thread-34::DEBUG::2014-08-21 12:05:26,040::task::827::TaskManager.Task::(resourceAcquired) Task=`68b250c7-4b44-4950-b86a-e4092136ff6f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:05:26,040::task::990::TaskManager.Task::(_decref) Task=`68b250c7-4b44-4950-b86a-e4092136ff6f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:05:26,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:26,048::task::1185::TaskManager.Task::(prepare) Task=`68b250c7-4b44-4950-b86a-e4092136ff6f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:26,048::task::595::TaskManager.Task::(_updateState) Task=`68b250c7-4b44-4950-b86a-e4092136ff6f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:05:26,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:05:26,049::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:05:26,049::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:05:26,049::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:05:26,050::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:05:26,050::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:05:26,050::task::990::TaskManager.Task::(_decref) Task=`68b250c7-4b44-4950-b86a-e4092136ff6f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:05:26,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.72549 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:28,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:28,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0808413 s, 12.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:05:29,033::task::595::TaskManager.Task::(_updateState) Task=`7d1d8654-0da6-496e-97b0-8f377a852d4f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:05:29,034::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:05:29,034::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0019441', 'lastCheck': '8.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:05:29,035::task::1185::TaskManager.Task::(prepare) Task=`7d1d8654-0da6-496e-97b0-8f377a852d4f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0019441', 'lastCheck': '8.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:05:29,035::task::595::TaskManager.Task::(_updateState) Task=`7d1d8654-0da6-496e-97b0-8f377a852d4f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:05:29,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:05:29,036::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:05:29,036::task::990::TaskManager.Task::(_decref) Task=`7d1d8654-0da6-496e-97b0-8f377a852d4f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:05:31,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:05:32,646::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:05:32,675::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00208664 s, 239 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:32,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.705212 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:34,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:34,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0661547 s, 15.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:37,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:05:37,583::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-26::DEBUG::2014-08-21 12:05:37,584::task::595::TaskManager.Task::(_updateState) Task=`aa4724d9-847d-4089-978f-130b1dff0c0e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:05:37,585::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:05:37,586::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:05:37,586::task::1185::TaskManager.Task::(prepare) Task=`aa4724d9-847d-4089-978f-130b1dff0c0e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:05:37,586::task::595::TaskManager.Task::(_updateState) Task=`aa4724d9-847d-4089-978f-130b1dff0c0e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:05:37,587::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:05:37,587::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:05:37,587::task::990::TaskManager.Task::(_decref) Task=`aa4724d9-847d-4089-978f-130b1dff0c0e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:05:37,592::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [41915a84]
>Thread-34::DEBUG::2014-08-21 12:05:37,592::task::595::TaskManager.Task::(_updateState) Task=`35339c12-9bdb-4362-9156-8672920bc3a4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:05:37,593::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:05:37,593::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1741adc9-b1d2-4663-83e8-880fc30f65cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:05:37,594::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:05:37,594::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:05:37,594::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1741adc9-b1d2-4663-83e8-880fc30f65cd`::Granted request
>Thread-34::DEBUG::2014-08-21 12:05:37,595::task::827::TaskManager.Task::(resourceAcquired) Task=`35339c12-9bdb-4362-9156-8672920bc3a4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:05:37,595::task::990::TaskManager.Task::(_decref) Task=`35339c12-9bdb-4362-9156-8672920bc3a4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:05:37,599::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:37,600::task::1185::TaskManager.Task::(prepare) Task=`35339c12-9bdb-4362-9156-8672920bc3a4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:37,600::task::595::TaskManager.Task::(_updateState) Task=`35339c12-9bdb-4362-9156-8672920bc3a4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:05:37,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:05:37,601::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:05:37,601::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:05:37,601::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:05:37,602::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:05:37,602::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:05:37,602::task::990::TaskManager.Task::(_decref) Task=`35339c12-9bdb-4362-9156-8672920bc3a4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:05:38,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.4607 s, 2.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:40,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:05:47,847::task::595::TaskManager.Task::(_updateState) Task=`dd236b07-5d36-497c-80a8-c940b013b0cb`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:05:47,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::DEBUG::2014-08-21 12:05:47,913::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-26::INFO::2014-08-21 12:05:48,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00208664', 'lastCheck': '15.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:05:48,313::task::595::TaskManager.Task::(_updateState) Task=`015859da-17f1-4857-91ac-9c4402acbebf`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:05:48,374::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:05:48,375::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:05:48,375::task::1185::TaskManager.Task::(prepare) Task=`015859da-17f1-4857-91ac-9c4402acbebf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:05:48,376::task::595::TaskManager.Task::(_updateState) Task=`015859da-17f1-4857-91ac-9c4402acbebf`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:05:48,396::task::1185::TaskManager.Task::(prepare) Task=`dd236b07-5d36-497c-80a8-c940b013b0cb`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00208664', 'lastCheck': '15.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:05:48,397::task::595::TaskManager.Task::(_updateState) Task=`dd236b07-5d36-497c-80a8-c940b013b0cb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:05:48,397::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:05:48,398::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:05:48,398::task::990::TaskManager.Task::(_decref) Task=`dd236b07-5d36-497c-80a8-c940b013b0cb`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:05:48,395::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:05:48,704::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:05:48,704::task::990::TaskManager.Task::(_decref) Task=`015859da-17f1-4857-91ac-9c4402acbebf`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:05:48,861::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:05:49,059::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00873591 s, 57.0 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:05:49,275::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 12:05:49,277::task::595::TaskManager.Task::(_updateState) Task=`971cd0af-aae3-4246-829d-682d028223a3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:05:49,278::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:05:49,385::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b5667718-fb4f-47bf-8fe2-bcfb2efb05d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:05:49,385::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:05:49,386::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:05:49,401::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b5667718-fb4f-47bf-8fe2-bcfb2efb05d7`::Granted request
>Thread-34::DEBUG::2014-08-21 12:05:49,420::task::827::TaskManager.Task::(resourceAcquired) Task=`971cd0af-aae3-4246-829d-682d028223a3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:05:49,421::task::990::TaskManager.Task::(_decref) Task=`971cd0af-aae3-4246-829d-682d028223a3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:05:50,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:50,177::task::1185::TaskManager.Task::(prepare) Task=`971cd0af-aae3-4246-829d-682d028223a3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:05:50,476::task::595::TaskManager.Task::(_updateState) Task=`971cd0af-aae3-4246-829d-682d028223a3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:05:50,476::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:05:50,477::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:05:50,477::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:05:50,478::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:05:50,478::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:05:50,478::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:05:50,479::task::990::TaskManager.Task::(_decref) Task=`971cd0af-aae3-4246-829d-682d028223a3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:05:50,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.1607 s, 101 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:53,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:56,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.336679 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:05:58,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:05:59,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.536686 s, 1.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:06:00,602::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-26::DEBUG::2014-08-21 12:06:00,660::task::595::TaskManager.Task::(_updateState) Task=`84756515-d630-4cc7-9601-523bdcc5464d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:06:00,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:06:00,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:06:00,672::task::1185::TaskManager.Task::(prepare) Task=`84756515-d630-4cc7-9601-523bdcc5464d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:06:00,679::task::595::TaskManager.Task::(_updateState) Task=`84756515-d630-4cc7-9601-523bdcc5464d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:06:00,682::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:06:00,693::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:06:00,721::task::990::TaskManager.Task::(_decref) Task=`84756515-d630-4cc7-9601-523bdcc5464d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:06:00,802::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-34::DEBUG::2014-08-21 12:06:00,946::task::595::TaskManager.Task::(_updateState) Task=`b0499a3d-0cc3-4800-82a3-81ead636b9ac`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:06:00,969::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:06:00,971::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1dbc03b0-35c9-4e96-ac42-bc967a4b4c64`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:06:00,971::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:06:00,972::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:06:00,972::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1dbc03b0-35c9-4e96-ac42-bc967a4b4c64`::Granted request
>Thread-34::DEBUG::2014-08-21 12:06:00,974::task::827::TaskManager.Task::(resourceAcquired) Task=`b0499a3d-0cc3-4800-82a3-81ead636b9ac`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:06:01,057::task::990::TaskManager.Task::(_decref) Task=`b0499a3d-0cc3-4800-82a3-81ead636b9ac`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:06:01,248::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:01,249::task::1185::TaskManager.Task::(prepare) Task=`b0499a3d-0cc3-4800-82a3-81ead636b9ac`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:01,250::task::595::TaskManager.Task::(_updateState) Task=`b0499a3d-0cc3-4800-82a3-81ead636b9ac`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:06:01,250::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-15::DEBUG::2014-08-21 12:06:01,401::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:06:01,407::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Dummy-33::DEBUG::2014-08-21 12:06:02,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:06:01,468::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-15::DEBUG::2014-08-21 12:06:02,874::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00405618 s, 123 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:06:04,377::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:06:04,401::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:06:04,914::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:06:08,219::task::990::TaskManager.Task::(_decref) Task=`b0499a3d-0cc3-4800-82a3-81ead636b9ac`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:06:08,457::task::595::TaskManager.Task::(_updateState) Task=`d7da493b-6e7c-4c29-9a2e-cee00f7b7033`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:06:08,477::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:06:08,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00405618', 'lastCheck': '3.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:06:08,559::task::1185::TaskManager.Task::(prepare) Task=`d7da493b-6e7c-4c29-9a2e-cee00f7b7033`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00405618', 'lastCheck': '3.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:06:08,560::task::595::TaskManager.Task::(_updateState) Task=`d7da493b-6e7c-4c29-9a2e-cee00f7b7033`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:06:08,690::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:06:08,906::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:06:08,907::task::990::TaskManager.Task::(_decref) Task=`d7da493b-6e7c-4c29-9a2e-cee00f7b7033`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:06:10,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.47097 s, 137 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:12,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:06:15,718::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:06:15,761::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0161727 s, 30.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:15,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.94778 s, 347 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:17,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:06:17,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0626851 s, 16.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:06:18,369::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-26::DEBUG::2014-08-21 12:06:18,375::task::595::TaskManager.Task::(_updateState) Task=`2f9a9007-2036-41ce-ae27-ada34a20e66f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:06:18,375::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:06:18,376::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:06:18,376::task::1185::TaskManager.Task::(prepare) Task=`2f9a9007-2036-41ce-ae27-ada34a20e66f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:06:18,377::task::595::TaskManager.Task::(_updateState) Task=`2f9a9007-2036-41ce-ae27-ada34a20e66f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:06:18,377::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:06:18,377::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:06:18,377::task::990::TaskManager.Task::(_decref) Task=`2f9a9007-2036-41ce-ae27-ada34a20e66f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:06:18,383::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [55791872]
>Thread-34::DEBUG::2014-08-21 12:06:18,384::task::595::TaskManager.Task::(_updateState) Task=`f346c8a4-ccea-4c70-b98b-0dfb7d571f2e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:06:18,384::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:06:18,385::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`417c71a4-d1dd-423f-889a-8571a06069b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:06:18,385::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:06:18,386::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:06:18,386::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`417c71a4-d1dd-423f-889a-8571a06069b6`::Granted request
>Thread-34::DEBUG::2014-08-21 12:06:18,387::task::827::TaskManager.Task::(resourceAcquired) Task=`f346c8a4-ccea-4c70-b98b-0dfb7d571f2e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:06:18,387::task::990::TaskManager.Task::(_decref) Task=`f346c8a4-ccea-4c70-b98b-0dfb7d571f2e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:06:18,393::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:18,393::task::1185::TaskManager.Task::(prepare) Task=`f346c8a4-ccea-4c70-b98b-0dfb7d571f2e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:18,394::task::595::TaskManager.Task::(_updateState) Task=`f346c8a4-ccea-4c70-b98b-0dfb7d571f2e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:06:18,394::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:06:18,394::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:06:18,395::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:06:18,395::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:06:18,396::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:06:18,397::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:06:18,398::task::990::TaskManager.Task::(_decref) Task=`f346c8a4-ccea-4c70-b98b-0dfb7d571f2e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:06:19,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:06:20,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.30072 s, 3.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:22,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:06:22,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119755 s, 8.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:24,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:06:25,399::task::595::TaskManager.Task::(_updateState) Task=`f6537c05-8618-4b52-826d-8f67817bf61f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:06:25,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:06:25,510::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0161727', 'lastCheck': '9.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:06:25,511::task::1185::TaskManager.Task::(prepare) Task=`f6537c05-8618-4b52-826d-8f67817bf61f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0161727', 'lastCheck': '9.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:06:25,512::task::595::TaskManager.Task::(_updateState) Task=`f6537c05-8618-4b52-826d-8f67817bf61f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:06:25,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:06:25,513::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:06:25,524::task::990::TaskManager.Task::(_decref) Task=`f6537c05-8618-4b52-826d-8f67817bf61f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:06:26,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.06342 s, 963 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:06:26,461::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:06:26,628::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000581625 s, 856 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:29,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:06:29,332::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-26::DEBUG::2014-08-21 12:06:29,350::task::595::TaskManager.Task::(_updateState) Task=`fd8a8846-2225-46ae-8a5c-dd84f726f32a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:06:29,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:06:29,353::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:06:29,354::task::1185::TaskManager.Task::(prepare) Task=`fd8a8846-2225-46ae-8a5c-dd84f726f32a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:06:29,354::task::595::TaskManager.Task::(_updateState) Task=`fd8a8846-2225-46ae-8a5c-dd84f726f32a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:06:29,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:06:29,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:06:29,355::task::990::TaskManager.Task::(_decref) Task=`fd8a8846-2225-46ae-8a5c-dd84f726f32a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:06:29,360::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-34::DEBUG::2014-08-21 12:06:29,361::task::595::TaskManager.Task::(_updateState) Task=`bf3bb6e6-1dda-4c78-8c1b-515d075dac2c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:06:29,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:06:29,362::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`841e6602-7e9f-4c5b-acc3-63cd111ed53b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:06:29,363::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:06:29,363::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:06:29,363::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`841e6602-7e9f-4c5b-acc3-63cd111ed53b`::Granted request
>Thread-34::DEBUG::2014-08-21 12:06:29,364::task::827::TaskManager.Task::(resourceAcquired) Task=`bf3bb6e6-1dda-4c78-8c1b-515d075dac2c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:06:29,365::task::990::TaskManager.Task::(_decref) Task=`bf3bb6e6-1dda-4c78-8c1b-515d075dac2c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:06:29,371::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:29,371::task::1185::TaskManager.Task::(prepare) Task=`bf3bb6e6-1dda-4c78-8c1b-515d075dac2c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:29,371::task::595::TaskManager.Task::(_updateState) Task=`bf3bb6e6-1dda-4c78-8c1b-515d075dac2c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:06:29,372::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:06:29,372::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:06:29,373::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:06:29,373::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:06:29,373::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:06:29,373::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:06:29,374::task::990::TaskManager.Task::(_decref) Task=`bf3bb6e6-1dda-4c78-8c1b-515d075dac2c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:06:29,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.127868 s, 8.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:31,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:06:31,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.148396 s, 6.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:33,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:06:33,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0790926 s, 12.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:35,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:06:36,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.177723 s, 5.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:06:36,724::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:06:36,744::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000744702 s, 669 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:38,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:06:38,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0702468 s, 14.6 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:06:39,390::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-26::DEBUG::2014-08-21 12:06:39,391::task::595::TaskManager.Task::(_updateState) Task=`bee5faf8-adb0-4527-aa25-fafe4cae4941`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:06:39,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:06:39,393::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:06:39,393::task::1185::TaskManager.Task::(prepare) Task=`bee5faf8-adb0-4527-aa25-fafe4cae4941`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:06:39,393::task::595::TaskManager.Task::(_updateState) Task=`bee5faf8-adb0-4527-aa25-fafe4cae4941`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:06:39,394::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:06:39,394::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:06:39,394::task::990::TaskManager.Task::(_decref) Task=`bee5faf8-adb0-4527-aa25-fafe4cae4941`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:06:39,491::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 12:06:39,492::task::595::TaskManager.Task::(_updateState) Task=`7d70854c-0ba7-42c1-921a-7d9a29a6019c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:06:39,492::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:06:39,493::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7a7e9953-0e16-437a-bd0a-656f8473c755`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:06:39,493::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:06:39,493::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:06:39,493::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7a7e9953-0e16-437a-bd0a-656f8473c755`::Granted request
>Thread-34::DEBUG::2014-08-21 12:06:39,494::task::827::TaskManager.Task::(resourceAcquired) Task=`7d70854c-0ba7-42c1-921a-7d9a29a6019c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:06:39,494::task::990::TaskManager.Task::(_decref) Task=`7d70854c-0ba7-42c1-921a-7d9a29a6019c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:06:39,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:39,500::task::1185::TaskManager.Task::(prepare) Task=`7d70854c-0ba7-42c1-921a-7d9a29a6019c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:39,500::task::595::TaskManager.Task::(_updateState) Task=`7d70854c-0ba7-42c1-921a-7d9a29a6019c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:06:39,500::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:06:39,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:06:39,501::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:06:39,502::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:06:39,502::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:06:39,503::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:06:39,503::task::990::TaskManager.Task::(_decref) Task=`7d70854c-0ba7-42c1-921a-7d9a29a6019c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:06:40,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:06:41,645::task::595::TaskManager.Task::(_updateState) Task=`40cbc14b-ad6c-4e31-a4a5-3211558e6d94`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:06:41,646::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:06:41,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744702', 'lastCheck': '4.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:06:41,646::task::1185::TaskManager.Task::(prepare) Task=`40cbc14b-ad6c-4e31-a4a5-3211558e6d94`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744702', 'lastCheck': '4.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:06:41,646::task::595::TaskManager.Task::(_updateState) Task=`40cbc14b-ad6c-4e31-a4a5-3211558e6d94`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:06:41,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:06:41,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:06:41,647::task::990::TaskManager.Task::(_decref) Task=`40cbc14b-ad6c-4e31-a4a5-3211558e6d94`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:06:41,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.972191 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:06:43,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:06:55,865::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-13::DEBUG::2014-08-21 12:06:56,141::task::595::TaskManager.Task::(_updateState) Task=`92674cbc-137d-40e3-bafd-529fcc82d75c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:06:56,320::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:06:56,321::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:06:56,321::task::1185::TaskManager.Task::(prepare) Task=`92674cbc-137d-40e3-bafd-529fcc82d75c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:06:56,322::task::595::TaskManager.Task::(_updateState) Task=`92674cbc-137d-40e3-bafd-529fcc82d75c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:06:56,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:06:56,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:06:56,323::task::990::TaskManager.Task::(_decref) Task=`92674cbc-137d-40e3-bafd-529fcc82d75c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:06:56,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.666 s, 96.0 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:06:57,630::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-34::DEBUG::2014-08-21 12:06:57,631::task::595::TaskManager.Task::(_updateState) Task=`ae9803cd-dbf7-4ab8-822e-198b51147758`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:06:57,632::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:06:57,633::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8769153f-e8a2-4299-854f-d16776eeff37`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:06:57,633::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:06:57,634::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:06:57,634::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8769153f-e8a2-4299-854f-d16776eeff37`::Granted request
>Thread-34::DEBUG::2014-08-21 12:06:57,635::task::827::TaskManager.Task::(resourceAcquired) Task=`ae9803cd-dbf7-4ab8-822e-198b51147758`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:06:57,636::task::990::TaskManager.Task::(_decref) Task=`ae9803cd-dbf7-4ab8-822e-198b51147758`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:06:57,652::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:06:58,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:06:59,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00466746 s, 107 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 12:06:59,333::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:59,334::task::1185::TaskManager.Task::(prepare) Task=`ae9803cd-dbf7-4ab8-822e-198b51147758`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:06:59,334::task::595::TaskManager.Task::(_updateState) Task=`ae9803cd-dbf7-4ab8-822e-198b51147758`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:06:59,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:06:59,335::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:06:59,335::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:06:59,336::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:06:59,336::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:06:59,367::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:06:59,379::task::990::TaskManager.Task::(_decref) Task=`ae9803cd-dbf7-4ab8-822e-198b51147758`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:06:59,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.511089 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:01,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:01,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121228 s, 8.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:04,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:05,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.593306 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:08,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:08,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0692787 s, 14.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:07:08,219::task::595::TaskManager.Task::(_updateState) Task=`2f4fa591-9560-47cb-86e3-2cfde6d4775f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:07:08,220::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:07:08,220::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00466746', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:07:08,221::task::1185::TaskManager.Task::(prepare) Task=`2f4fa591-9560-47cb-86e3-2cfde6d4775f`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00466746', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:07:08,221::task::595::TaskManager.Task::(_updateState) Task=`2f4fa591-9560-47cb-86e3-2cfde6d4775f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:07:08,221::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:07:08,222::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:07:08,222::task::990::TaskManager.Task::(_decref) Task=`2f4fa591-9560-47cb-86e3-2cfde6d4775f`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:07:09,511::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-13::DEBUG::2014-08-21 12:07:09,513::task::595::TaskManager.Task::(_updateState) Task=`eaaadc6d-c936-478f-ba4b-c70011c96cfa`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:07:09,514::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:07:09,515::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:09,520::task::1185::TaskManager.Task::(prepare) Task=`eaaadc6d-c936-478f-ba4b-c70011c96cfa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:09,521::task::595::TaskManager.Task::(_updateState) Task=`eaaadc6d-c936-478f-ba4b-c70011c96cfa`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:07:09,521::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:07:09,522::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:07:09,525::task::990::TaskManager.Task::(_decref) Task=`eaaadc6d-c936-478f-ba4b-c70011c96cfa`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:07:09,822::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-34::DEBUG::2014-08-21 12:07:09,824::task::595::TaskManager.Task::(_updateState) Task=`fee0a174-34a5-444d-b339-7cc254c60adf`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:07:09,825::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:07:09,826::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`21cd5c98-6ddf-40e4-9bda-5a56f0d29891`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:07:09,827::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:07:09,828::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:07:09,829::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`21cd5c98-6ddf-40e4-9bda-5a56f0d29891`::Granted request
>Thread-34::DEBUG::2014-08-21 12:07:09,883::task::827::TaskManager.Task::(resourceAcquired) Task=`fee0a174-34a5-444d-b339-7cc254c60adf`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:07:09,884::task::990::TaskManager.Task::(_decref) Task=`fee0a174-34a5-444d-b339-7cc254c60adf`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:07:10,234::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:10,235::task::1185::TaskManager.Task::(prepare) Task=`fee0a174-34a5-444d-b339-7cc254c60adf`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:10,248::task::595::TaskManager.Task::(_updateState) Task=`fee0a174-34a5-444d-b339-7cc254c60adf`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:07:10,249::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:07:10,250::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:07:10,251::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-15::DEBUG::2014-08-21 12:07:10,263::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:10,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:07:10,822::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:07:12,029::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:07:12,030::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:07:12,053::task::990::TaskManager.Task::(_decref) Task=`fee0a174-34a5-444d-b339-7cc254c60adf`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:07:12,479::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0740425 s, 6.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:13,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.75069 s, 372 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:15,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:19,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.15613 s, 886 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:22,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:23,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.716719 s, 1.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:07:23,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:07:23,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2b31c94b]
>Thread-13::DEBUG::2014-08-21 12:07:23,481::task::595::TaskManager.Task::(_updateState) Task=`01e8e5b7-6870-401d-8647-2d1fc70eb11c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:07:23,482::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:07:23,483::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:23,484::task::1185::TaskManager.Task::(prepare) Task=`01e8e5b7-6870-401d-8647-2d1fc70eb11c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:23,484::task::595::TaskManager.Task::(_updateState) Task=`01e8e5b7-6870-401d-8647-2d1fc70eb11c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:07:23,485::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:07:23,485::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:07:23,486::task::990::TaskManager.Task::(_decref) Task=`01e8e5b7-6870-401d-8647-2d1fc70eb11c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:07:23,503::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0285918 s, 17.4 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:07:23,607::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2b31c94b]
>Thread-34::DEBUG::2014-08-21 12:07:23,608::task::595::TaskManager.Task::(_updateState) Task=`d91717e7-4373-401b-982b-184b6731c2b9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:07:23,609::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:07:23,670::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8c77a3e8-2e9c-4f88-9aae-c0f776e3e99e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:07:23,671::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:07:23,671::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:07:23,671::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8c77a3e8-2e9c-4f88-9aae-c0f776e3e99e`::Granted request
>Thread-34::DEBUG::2014-08-21 12:07:23,672::task::827::TaskManager.Task::(resourceAcquired) Task=`d91717e7-4373-401b-982b-184b6731c2b9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:07:23,672::task::990::TaskManager.Task::(_decref) Task=`d91717e7-4373-401b-982b-184b6731c2b9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:07:23,678::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:23,678::task::1185::TaskManager.Task::(prepare) Task=`d91717e7-4373-401b-982b-184b6731c2b9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:23,679::task::595::TaskManager.Task::(_updateState) Task=`d91717e7-4373-401b-982b-184b6731c2b9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:07:23,679::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:07:23,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:07:23,680::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:07:23,680::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:07:23,680::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:07:23,680::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:07:23,681::task::990::TaskManager.Task::(_decref) Task=`d91717e7-4373-401b-982b-184b6731c2b9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:07:25,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:25,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0787145 s, 13.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:07:25,476::task::595::TaskManager.Task::(_updateState) Task=`f8f9f8d1-d61c-4a00-8e5c-17074c45c98c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:07:25,478::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:07:25,480::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0285918', 'lastCheck': '1.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:07:25,481::task::1185::TaskManager.Task::(prepare) Task=`f8f9f8d1-d61c-4a00-8e5c-17074c45c98c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0285918', 'lastCheck': '1.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:07:25,482::task::595::TaskManager.Task::(_updateState) Task=`f8f9f8d1-d61c-4a00-8e5c-17074c45c98c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:07:25,484::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:07:25,485::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:07:25,486::task::990::TaskManager.Task::(_decref) Task=`f8f9f8d1-d61c-4a00-8e5c-17074c45c98c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:07:27,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:27,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.057202 s, 17.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:29,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:30,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0609398 s, 16.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:32,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:32,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.219477 s, 4.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:07:34,165::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-13::DEBUG::2014-08-21 12:07:34,166::task::595::TaskManager.Task::(_updateState) Task=`2aaf2306-01f2-4bb4-9732-6438db526c58`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:07:34,166::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:07:34,167::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:34,173::task::1185::TaskManager.Task::(prepare) Task=`2aaf2306-01f2-4bb4-9732-6438db526c58`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:34,232::task::595::TaskManager.Task::(_updateState) Task=`2aaf2306-01f2-4bb4-9732-6438db526c58`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:07:34,305::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:07:34,305::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:07:34,306::task::990::TaskManager.Task::(_decref) Task=`2aaf2306-01f2-4bb4-9732-6438db526c58`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:07:34,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:07:34,818::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [17fce49b]
>Thread-34::DEBUG::2014-08-21 12:07:34,826::task::595::TaskManager.Task::(_updateState) Task=`a64e027e-3fd2-4a79-ad7d-9b7cf37448e1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:07:34,829::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 12:07:34,834::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:07:34,860::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2e16d2d1-257a-4320-ac64-48ba38855772`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:07:34,862::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:07:34,870::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:07:34,879::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`2e16d2d1-257a-4320-ac64-48ba38855772`::Granted request
>Thread-34::DEBUG::2014-08-21 12:07:34,892::task::827::TaskManager.Task::(resourceAcquired) Task=`a64e027e-3fd2-4a79-ad7d-9b7cf37448e1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:07:34,895::task::990::TaskManager.Task::(_decref) Task=`a64e027e-3fd2-4a79-ad7d-9b7cf37448e1`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:07:34,898::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00151247 s, 329 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 12:07:34,957::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:34,958::task::1185::TaskManager.Task::(prepare) Task=`a64e027e-3fd2-4a79-ad7d-9b7cf37448e1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:34,959::task::595::TaskManager.Task::(_updateState) Task=`a64e027e-3fd2-4a79-ad7d-9b7cf37448e1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:07:34,961::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:07:34,962::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:07:34,964::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:07:34,966::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:07:34,967::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:07:34,968::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:07:34,970::task::990::TaskManager.Task::(_decref) Task=`a64e027e-3fd2-4a79-ad7d-9b7cf37448e1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:07:35,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.192247 s, 5.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:37,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:37,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.13311 s, 7.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:39,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:39,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.384509 s, 2.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:07:40,822::task::595::TaskManager.Task::(_updateState) Task=`36c0763d-a386-4344-85f2-ef2ec621ad26`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:07:40,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:07:40,825::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00151247', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:07:40,825::task::1185::TaskManager.Task::(prepare) Task=`36c0763d-a386-4344-85f2-ef2ec621ad26`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00151247', 'lastCheck': '5.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:07:40,825::task::595::TaskManager.Task::(_updateState) Task=`36c0763d-a386-4344-85f2-ef2ec621ad26`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:07:40,826::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:07:40,826::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:07:40,827::task::990::TaskManager.Task::(_decref) Task=`36c0763d-a386-4344-85f2-ef2ec621ad26`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:07:41,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:42,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0679034 s, 15.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:44,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:44,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.108636 s, 9.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:07:44,962::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:07:44,978::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00103116 s, 483 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:07:44,997::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-13::DEBUG::2014-08-21 12:07:44,998::task::595::TaskManager.Task::(_updateState) Task=`256a92c6-0619-49d8-b12b-b60953219ef7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:07:44,999::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:07:45,001::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:45,001::task::1185::TaskManager.Task::(prepare) Task=`256a92c6-0619-49d8-b12b-b60953219ef7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:45,002::task::595::TaskManager.Task::(_updateState) Task=`256a92c6-0619-49d8-b12b-b60953219ef7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:07:45,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:07:45,002::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:07:45,003::task::990::TaskManager.Task::(_decref) Task=`256a92c6-0619-49d8-b12b-b60953219ef7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:07:45,008::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-34::DEBUG::2014-08-21 12:07:45,009::task::595::TaskManager.Task::(_updateState) Task=`0a9a8842-7a71-4b20-8b17-1b2997980b09`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:07:45,010::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:07:45,010::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b6be476c-87fd-46b6-9b9c-2b967036adda`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:07:45,011::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:07:45,011::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:07:45,011::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b6be476c-87fd-46b6-9b9c-2b967036adda`::Granted request
>Thread-34::DEBUG::2014-08-21 12:07:45,014::task::827::TaskManager.Task::(resourceAcquired) Task=`0a9a8842-7a71-4b20-8b17-1b2997980b09`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:07:45,014::task::990::TaskManager.Task::(_decref) Task=`0a9a8842-7a71-4b20-8b17-1b2997980b09`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:07:45,019::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:45,019::task::1185::TaskManager.Task::(prepare) Task=`0a9a8842-7a71-4b20-8b17-1b2997980b09`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:45,019::task::595::TaskManager.Task::(_updateState) Task=`0a9a8842-7a71-4b20-8b17-1b2997980b09`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:07:45,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:07:45,019::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:07:45,020::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:07:45,020::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:07:45,020::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:07:45,020::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:07:45,021::task::990::TaskManager.Task::(_decref) Task=`0a9a8842-7a71-4b20-8b17-1b2997980b09`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:07:46,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:46,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.159518 s, 6.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:48,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:48,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.197861 s, 5.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:51,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:51,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0969729 s, 10.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:53,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:53,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0890777 s, 11.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:07:55,003::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:07:55,027::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000657843 s, 757 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:07:55,040::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-13::DEBUG::2014-08-21 12:07:55,042::task::595::TaskManager.Task::(_updateState) Task=`32d360bf-0ca4-4ddb-af4a-cd6fc7acc520`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:07:55,043::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:07:55,044::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:55,045::task::1185::TaskManager.Task::(prepare) Task=`32d360bf-0ca4-4ddb-af4a-cd6fc7acc520`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:07:55,046::task::595::TaskManager.Task::(_updateState) Task=`32d360bf-0ca4-4ddb-af4a-cd6fc7acc520`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:07:55,046::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:07:55,046::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:07:55,047::task::990::TaskManager.Task::(_decref) Task=`32d360bf-0ca4-4ddb-af4a-cd6fc7acc520`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:07:55,068::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 12:07:55,069::task::595::TaskManager.Task::(_updateState) Task=`d9082065-e45e-46c4-9e86-74c2e442cbf0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:07:55,070::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:07:55,071::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aabdbb03-96d2-48e5-bfb5-1c469a18b6ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:07:55,071::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:07:55,071::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:07:55,072::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aabdbb03-96d2-48e5-bfb5-1c469a18b6ac`::Granted request
>Thread-34::DEBUG::2014-08-21 12:07:55,072::task::827::TaskManager.Task::(resourceAcquired) Task=`d9082065-e45e-46c4-9e86-74c2e442cbf0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:07:55,073::task::990::TaskManager.Task::(_decref) Task=`d9082065-e45e-46c4-9e86-74c2e442cbf0`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:07:55,081::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:55,094::task::1185::TaskManager.Task::(prepare) Task=`d9082065-e45e-46c4-9e86-74c2e442cbf0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:07:55,094::task::595::TaskManager.Task::(_updateState) Task=`d9082065-e45e-46c4-9e86-74c2e442cbf0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:07:55,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:07:55,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:07:55,095::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:07:55,096::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:07:55,096::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:07:55,096::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:07:55,097::task::990::TaskManager.Task::(_decref) Task=`d9082065-e45e-46c4-9e86-74c2e442cbf0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:07:55,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:55,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0733309 s, 14.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:07:56,159::task::595::TaskManager.Task::(_updateState) Task=`95d83d92-0914-4f6f-ae60-14309f175caf`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:07:56,160::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:07:56,160::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657843', 'lastCheck': '1.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:07:56,161::task::1185::TaskManager.Task::(prepare) Task=`95d83d92-0914-4f6f-ae60-14309f175caf`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657843', 'lastCheck': '1.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:07:56,162::task::595::TaskManager.Task::(_updateState) Task=`95d83d92-0914-4f6f-ae60-14309f175caf`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:07:56,163::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:07:56,163::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:07:56,164::task::990::TaskManager.Task::(_decref) Task=`95d83d92-0914-4f6f-ae60-14309f175caf`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:07:57,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:07:57,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0666607 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:07:59,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:01,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.720985 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:03,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:03,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0517934 s, 19.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:08:05,032::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:08:05,054::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:08:05,057::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 12:08:05,069::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 12:08:05,077::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 12:08:05,077::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 12:08:05,078::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 12:08:05,107::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:08:05,140::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-13::DEBUG::2014-08-21 12:08:05,600::task::595::TaskManager.Task::(_updateState) Task=`5d2efcf3-68e8-456c-8a49-0827bce1e3af`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:08:05,601::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:08:05,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:08:05,603::task::1185::TaskManager.Task::(prepare) Task=`5d2efcf3-68e8-456c-8a49-0827bce1e3af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:08:05,604::task::595::TaskManager.Task::(_updateState) Task=`5d2efcf3-68e8-456c-8a49-0827bce1e3af`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:08:05,604::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:08:05,605::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:08:05,605::task::990::TaskManager.Task::(_decref) Task=`5d2efcf3-68e8-456c-8a49-0827bce1e3af`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:08:05,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:08:05,894::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-34::DEBUG::2014-08-21 12:08:05,895::task::595::TaskManager.Task::(_updateState) Task=`d8250467-5a00-4418-adde-3f31b2fbaaa0`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:08:05,896::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:08:05,897::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b86680d3-9b21-4582-a568-7f846ba97757`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:08:05,898::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:08:05,899::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:08:05,899::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b86680d3-9b21-4582-a568-7f846ba97757`::Granted request
>Thread-34::DEBUG::2014-08-21 12:08:05,900::task::827::TaskManager.Task::(resourceAcquired) Task=`d8250467-5a00-4418-adde-3f31b2fbaaa0`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:08:05,900::task::990::TaskManager.Task::(_decref) Task=`d8250467-5a00-4418-adde-3f31b2fbaaa0`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:08:05,966::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.013334 s, 37.3 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 12:08:05,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:05,997::task::1185::TaskManager.Task::(prepare) Task=`d8250467-5a00-4418-adde-3f31b2fbaaa0`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:05,997::task::595::TaskManager.Task::(_updateState) Task=`d8250467-5a00-4418-adde-3f31b2fbaaa0`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:08:05,998::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:08:05,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:08:06,006::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:08:06,013::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:08:06,013::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:08:06,014::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:08:06,040::task::990::TaskManager.Task::(_decref) Task=`d8250467-5a00-4418-adde-3f31b2fbaaa0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:08:06,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.431927 s, 2.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:08,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:08,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.069404 s, 14.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:10,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:10,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0558618 s, 18.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:08:11,695::task::595::TaskManager.Task::(_updateState) Task=`7d1295b5-3298-4ba2-b3fe-580a4b6edfac`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:08:11,696::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:08:11,696::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.013334', 'lastCheck': '5.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:08:11,697::task::1185::TaskManager.Task::(prepare) Task=`7d1295b5-3298-4ba2-b3fe-580a4b6edfac`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.013334', 'lastCheck': '5.6', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:08:11,697::task::595::TaskManager.Task::(_updateState) Task=`7d1295b5-3298-4ba2-b3fe-580a4b6edfac`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:08:11,697::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:08:11,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:08:11,698::task::990::TaskManager.Task::(_decref) Task=`7d1295b5-3298-4ba2-b3fe-580a4b6edfac`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:08:12,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:12,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405601 s, 25.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:14,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:14,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0569166 s, 18.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:08:16,226::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Dummy-33::DEBUG::2014-08-21 12:08:17,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:08:17,166::task::595::TaskManager.Task::(_updateState) Task=`0fe3f471-70ec-4520-b97f-473ee17a378e`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:08:18,043::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:08:18,083::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:08:18,086::task::1185::TaskManager.Task::(prepare) Task=`0fe3f471-70ec-4520-b97f-473ee17a378e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:08:18,432::task::595::TaskManager.Task::(_updateState) Task=`0fe3f471-70ec-4520-b97f-473ee17a378e`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:08:18,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:08:18,435::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:08:18,435::task::990::TaskManager.Task::(_decref) Task=`0fe3f471-70ec-4520-b97f-473ee17a378e`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:08:18,798::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 12:08:18,827::task::595::TaskManager.Task::(_updateState) Task=`f409499a-3b5e-4207-947a-12d5f044226c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:08:18,828::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:08:18,830::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`560d01f5-3478-4e9c-97a3-8d146eac16bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:08:18,830::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:08:18,831::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:08:18,831::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`560d01f5-3478-4e9c-97a3-8d146eac16bc`::Granted request
>Thread-34::DEBUG::2014-08-21 12:08:18,833::task::827::TaskManager.Task::(resourceAcquired) Task=`f409499a-3b5e-4207-947a-12d5f044226c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:08:18,834::task::990::TaskManager.Task::(_decref) Task=`f409499a-3b5e-4207-947a-12d5f044226c`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:08:18,968::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 12:08:19,262::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:19,264::task::1185::TaskManager.Task::(prepare) Task=`f409499a-3b5e-4207-947a-12d5f044226c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:19,266::task::595::TaskManager.Task::(_updateState) Task=`f409499a-3b5e-4207-947a-12d5f044226c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:08:19,268::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:08:19,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:08:19,273::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:08:19,275::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:08:19,277::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:08:19,278::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:08:19,281::task::990::TaskManager.Task::(_decref) Task=`f409499a-3b5e-4207-947a-12d5f044226c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:08:19,294::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0887806 s, 5.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:19,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.58681 s, 645 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:21,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:22,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.777349 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:25,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:25,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.400341 s, 2.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:27,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:28,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.618984 s, 1.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:08:28,733::task::595::TaskManager.Task::(_updateState) Task=`0561670c-3f77-47b1-8f8d-e66d6b68df24`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:08:28,734::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:08:28,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0887806', 'lastCheck': '9.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:08:28,735::task::1185::TaskManager.Task::(prepare) Task=`0561670c-3f77-47b1-8f8d-e66d6b68df24`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0887806', 'lastCheck': '9.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:08:28,735::task::595::TaskManager.Task::(_updateState) Task=`0561670c-3f77-47b1-8f8d-e66d6b68df24`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:08:28,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:08:28,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:08:28,737::task::990::TaskManager.Task::(_decref) Task=`0561670c-3f77-47b1-8f8d-e66d6b68df24`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:08:29,309::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-13::DEBUG::2014-08-21 12:08:29,311::task::595::TaskManager.Task::(_updateState) Task=`f105e490-610a-4cb2-a2e8-14221e4365ca`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:08:29,311::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:08:29,340::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:08:29,341::task::1185::TaskManager.Task::(prepare) Task=`f105e490-610a-4cb2-a2e8-14221e4365ca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:08:29,417::task::595::TaskManager.Task::(_updateState) Task=`f105e490-610a-4cb2-a2e8-14221e4365ca`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:08:29,444::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:08:29,933::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:08:30,012::task::990::TaskManager.Task::(_decref) Task=`f105e490-610a-4cb2-a2e8-14221e4365ca`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:08:30,346::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-34::DEBUG::2014-08-21 12:08:30,347::task::595::TaskManager.Task::(_updateState) Task=`01c0a428-a099-4c1f-9ee0-201ff5a313b9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:08:30,348::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:08:30,349::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`202d85d0-1393-4272-8196-838dd01cad05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:08:30,350::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:08:30,351::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:08:30,351::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`202d85d0-1393-4272-8196-838dd01cad05`::Granted request
>Thread-34::DEBUG::2014-08-21 12:08:30,352::task::827::TaskManager.Task::(resourceAcquired) Task=`01c0a428-a099-4c1f-9ee0-201ff5a313b9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:08:30,353::task::990::TaskManager.Task::(_decref) Task=`01c0a428-a099-4c1f-9ee0-201ff5a313b9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:08:30,405::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:30,405::task::1185::TaskManager.Task::(prepare) Task=`01c0a428-a099-4c1f-9ee0-201ff5a313b9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:30,406::task::595::TaskManager.Task::(_updateState) Task=`01c0a428-a099-4c1f-9ee0-201ff5a313b9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:08:30,406::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:08:30,406::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:08:30,407::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:08:30,407::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:08:30,407::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:08:30,407::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:08:30,408::task::990::TaskManager.Task::(_decref) Task=`01c0a428-a099-4c1f-9ee0-201ff5a313b9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:08:30,561::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:08:30,576::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000429891 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:30,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:30,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.131035 s, 7.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:32,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:33,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.227649 s, 4.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:35,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:08:46,807::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-26::DEBUG::2014-08-21 12:08:46,820::task::595::TaskManager.Task::(_updateState) Task=`0bac8d40-ffc3-4abd-9d60-07c2d6af0d4b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:08:46,821::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:08:46,823::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:08:47,403::task::1185::TaskManager.Task::(prepare) Task=`0bac8d40-ffc3-4abd-9d60-07c2d6af0d4b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:08:47,404::task::595::TaskManager.Task::(_updateState) Task=`0bac8d40-ffc3-4abd-9d60-07c2d6af0d4b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:08:47,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:08:47,404::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:08:47,405::task::990::TaskManager.Task::(_decref) Task=`0bac8d40-ffc3-4abd-9d60-07c2d6af0d4b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:08:48,268::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-34::DEBUG::2014-08-21 12:08:48,269::task::595::TaskManager.Task::(_updateState) Task=`13fc5521-7363-4557-a668-ed56fd71e75b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:08:48,270::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:08:48,333::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dc3faf49-f742-4c0e-9770-1c548d74550f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:08:48,334::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:08:48,335::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:08:48,335::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`dc3faf49-f742-4c0e-9770-1c548d74550f`::Granted request
>Thread-34::DEBUG::2014-08-21 12:08:48,336::task::827::TaskManager.Task::(resourceAcquired) Task=`13fc5521-7363-4557-a668-ed56fd71e75b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:08:48,892::task::990::TaskManager.Task::(_decref) Task=`13fc5521-7363-4557-a668-ed56fd71e75b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:08:49,154::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967301632', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:49,155::task::1185::TaskManager.Task::(prepare) Task=`13fc5521-7363-4557-a668-ed56fd71e75b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967301632', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:49,156::task::595::TaskManager.Task::(_updateState) Task=`13fc5521-7363-4557-a668-ed56fd71e75b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:08:49,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:08:49,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:08:49,272::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:08:49,276::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:08:49,277::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:08:49,277::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:08:49,278::task::990::TaskManager.Task::(_decref) Task=`13fc5521-7363-4557-a668-ed56fd71e75b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:08:50,484::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:08:51,702::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00372915 s, 134 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:52,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 17.4496 s, 58.7 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:08:54,495::task::595::TaskManager.Task::(_updateState) Task=`f447aecf-0cf0-4b88-acb1-dac1968947e7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:08:54,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:08:54,496::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00372915', 'lastCheck': '1.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:08:54,496::task::1185::TaskManager.Task::(prepare) Task=`f447aecf-0cf0-4b88-acb1-dac1968947e7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00372915', 'lastCheck': '1.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:08:54,496::task::595::TaskManager.Task::(_updateState) Task=`f447aecf-0cf0-4b88-acb1-dac1968947e7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:08:54,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:08:54,497::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:08:54,497::task::990::TaskManager.Task::(_decref) Task=`f447aecf-0cf0-4b88-acb1-dac1968947e7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:08:54,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:55,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0695034 s, 14.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:08:57,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:08:59,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.94629 s, 526 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:08:59,770::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-26::DEBUG::2014-08-21 12:08:59,771::task::595::TaskManager.Task::(_updateState) Task=`a059f302-0843-4a54-a744-71e1638c6c36`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:08:59,772::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:08:59,773::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:08:59,773::task::1185::TaskManager.Task::(prepare) Task=`a059f302-0843-4a54-a744-71e1638c6c36`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:08:59,773::task::595::TaskManager.Task::(_updateState) Task=`a059f302-0843-4a54-a744-71e1638c6c36`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:08:59,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:08:59,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:08:59,774::task::990::TaskManager.Task::(_decref) Task=`a059f302-0843-4a54-a744-71e1638c6c36`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:08:59,788::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 12:08:59,788::task::595::TaskManager.Task::(_updateState) Task=`862b20a6-743f-41c2-9cde-2d8ce3d0305f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:08:59,789::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:08:59,789::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8f4a596d-7216-4bd3-bfb0-a81357d926b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:08:59,789::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:08:59,790::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:08:59,790::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8f4a596d-7216-4bd3-bfb0-a81357d926b2`::Granted request
>Thread-34::DEBUG::2014-08-21 12:08:59,790::task::827::TaskManager.Task::(resourceAcquired) Task=`862b20a6-743f-41c2-9cde-2d8ce3d0305f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:08:59,791::task::990::TaskManager.Task::(_decref) Task=`862b20a6-743f-41c2-9cde-2d8ce3d0305f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:08:59,794::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:59,794::task::1185::TaskManager.Task::(prepare) Task=`862b20a6-743f-41c2-9cde-2d8ce3d0305f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:08:59,794::task::595::TaskManager.Task::(_updateState) Task=`862b20a6-743f-41c2-9cde-2d8ce3d0305f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:08:59,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:08:59,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:08:59,795::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:08:59,795::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:08:59,795::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:08:59,795::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:08:59,796::task::990::TaskManager.Task::(_decref) Task=`862b20a6-743f-41c2-9cde-2d8ce3d0305f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:09:01,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:01,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.082339 s, 12.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:09:02,811::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:09:02,858::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00124282 s, 401 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:03,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:03,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.544429 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:06,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:06,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0875158 s, 11.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:08,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:08,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.142733 s, 7.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:09:09,817::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-26::DEBUG::2014-08-21 12:09:09,819::task::595::TaskManager.Task::(_updateState) Task=`337291e8-0e0d-4c26-a7d7-4a82c9918bc2`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:09:09,819::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:09:09,820::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:09:09,820::task::1185::TaskManager.Task::(prepare) Task=`337291e8-0e0d-4c26-a7d7-4a82c9918bc2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:09:09,820::task::595::TaskManager.Task::(_updateState) Task=`337291e8-0e0d-4c26-a7d7-4a82c9918bc2`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:09:09,821::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:09:09,821::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:09:09,822::task::990::TaskManager.Task::(_decref) Task=`337291e8-0e0d-4c26-a7d7-4a82c9918bc2`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:09:09,830::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 12:09:09,831::task::595::TaskManager.Task::(_updateState) Task=`645d8839-045d-45a3-8c8a-1483b2d0bcf1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:09:09,832::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:09:09,833::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e2150229-58da-4efd-acd2-5ee685fd9030`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:09:09,833::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:09:09,834::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:09:09,834::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e2150229-58da-4efd-acd2-5ee685fd9030`::Granted request
>Thread-34::DEBUG::2014-08-21 12:09:09,836::task::827::TaskManager.Task::(resourceAcquired) Task=`645d8839-045d-45a3-8c8a-1483b2d0bcf1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:09:09,837::task::990::TaskManager.Task::(_decref) Task=`645d8839-045d-45a3-8c8a-1483b2d0bcf1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:09:09,843::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968481280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:09,843::task::1185::TaskManager.Task::(prepare) Task=`645d8839-045d-45a3-8c8a-1483b2d0bcf1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968481280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:09,844::task::595::TaskManager.Task::(_updateState) Task=`645d8839-045d-45a3-8c8a-1483b2d0bcf1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:09:09,844::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:09:09,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:09:09,845::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:09:09,845::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:09:09,845::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:09:09,846::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:09:09,846::task::990::TaskManager.Task::(_decref) Task=`645d8839-045d-45a3-8c8a-1483b2d0bcf1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:09:10,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:09:12,687::task::595::TaskManager.Task::(_updateState) Task=`8558f596-6829-4392-a563-7601641cec6a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:09:12,689::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:09:12,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00124282', 'lastCheck': '9.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:09:12,692::task::1185::TaskManager.Task::(prepare) Task=`8558f596-6829-4392-a563-7601641cec6a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00124282', 'lastCheck': '9.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:09:12,693::task::595::TaskManager.Task::(_updateState) Task=`8558f596-6829-4392-a563-7601641cec6a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:09:12,693::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:09:12,742::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:09:12,742::task::990::TaskManager.Task::(_decref) Task=`8558f596-6829-4392-a563-7601641cec6a`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:09:13,513::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:09:19,720::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00287158 s, 173 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:09:20,012::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Dummy-33::DEBUG::2014-08-21 12:09:20,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.371498 s, 2.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:09:20,602::task::595::TaskManager.Task::(_updateState) Task=`f3daf304-5115-4684-adeb-a81a844eb569`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:09:20,605::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:09:20,606::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:09:20,606::task::1185::TaskManager.Task::(prepare) Task=`f3daf304-5115-4684-adeb-a81a844eb569`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:09:20,607::task::595::TaskManager.Task::(_updateState) Task=`f3daf304-5115-4684-adeb-a81a844eb569`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:09:20,608::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:09:20,608::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:09:20,609::task::990::TaskManager.Task::(_decref) Task=`f3daf304-5115-4684-adeb-a81a844eb569`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:09:20,623::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 12:09:20,627::task::595::TaskManager.Task::(_updateState) Task=`61c8f7da-c53e-4cec-94f8-32e759fee040`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:09:20,631::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:09:20,638::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b37954ae-a9ab-4000-93c7-4fb5ece999a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:09:20,640::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:09:20,643::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:09:20,645::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b37954ae-a9ab-4000-93c7-4fb5ece999a0`::Granted request
>Thread-34::DEBUG::2014-08-21 12:09:20,649::task::827::TaskManager.Task::(resourceAcquired) Task=`61c8f7da-c53e-4cec-94f8-32e759fee040`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:09:20,650::task::990::TaskManager.Task::(_decref) Task=`61c8f7da-c53e-4cec-94f8-32e759fee040`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:09:20,687::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968481280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:20,689::task::1185::TaskManager.Task::(prepare) Task=`61c8f7da-c53e-4cec-94f8-32e759fee040`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968481280', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:20,690::task::595::TaskManager.Task::(_updateState) Task=`61c8f7da-c53e-4cec-94f8-32e759fee040`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:09:20,690::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:09:20,690::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:09:20,692::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:09:20,692::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:09:20,692::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:09:20,693::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:09:20,693::task::990::TaskManager.Task::(_decref) Task=`61c8f7da-c53e-4cec-94f8-32e759fee040`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:09:22,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:23,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.914906 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:25,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:25,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124477 s, 8.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:27,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:28,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.134496 s, 7.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:30,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:30,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.224175 s, 4.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:09:30,730::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-13::DEBUG::2014-08-21 12:09:30,731::task::595::TaskManager.Task::(_updateState) Task=`2813f390-330e-4199-97e8-736103f58ab7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:09:30,732::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:09:30,733::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:09:30,733::task::1185::TaskManager.Task::(prepare) Task=`2813f390-330e-4199-97e8-736103f58ab7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:09:30,733::task::595::TaskManager.Task::(_updateState) Task=`2813f390-330e-4199-97e8-736103f58ab7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:09:30,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:09:30,734::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:09:30,735::task::990::TaskManager.Task::(_decref) Task=`2813f390-330e-4199-97e8-736103f58ab7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:09:30,748::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3a84745d]
>Thread-34::DEBUG::2014-08-21 12:09:30,750::task::595::TaskManager.Task::(_updateState) Task=`d8db8a4f-a3bd-4863-bc0c-0fcf1fc4a270`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:09:30,751::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:09:30,751::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bfb62174-7c72-42a0-b158-db3fc19a1a0d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:09:30,752::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:09:30,752::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:09:30,752::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bfb62174-7c72-42a0-b158-db3fc19a1a0d`::Granted request
>Thread-34::DEBUG::2014-08-21 12:09:30,753::task::827::TaskManager.Task::(resourceAcquired) Task=`d8db8a4f-a3bd-4863-bc0c-0fcf1fc4a270`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:09:30,753::task::990::TaskManager.Task::(_decref) Task=`d8db8a4f-a3bd-4863-bc0c-0fcf1fc4a270`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:09:30,757::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:30,758::task::1185::TaskManager.Task::(prepare) Task=`d8db8a4f-a3bd-4863-bc0c-0fcf1fc4a270`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:30,758::task::595::TaskManager.Task::(_updateState) Task=`d8db8a4f-a3bd-4863-bc0c-0fcf1fc4a270`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:09:30,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:09:30,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:09:30,759::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:09:30,759::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:09:30,759::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:09:30,759::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:09:30,760::task::990::TaskManager.Task::(_decref) Task=`d8db8a4f-a3bd-4863-bc0c-0fcf1fc4a270`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:09:32,000::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:09:32,018::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000877738 s, 567 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:32,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:09:32,717::task::595::TaskManager.Task::(_updateState) Task=`d04baeda-9af4-4cd1-b343-b8bbce33bdc2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:09:32,720::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:09:32,722::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000877738', 'lastCheck': '0.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:09:32,723::task::1185::TaskManager.Task::(prepare) Task=`d04baeda-9af4-4cd1-b343-b8bbce33bdc2`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000877738', 'lastCheck': '0.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:09:32,724::task::595::TaskManager.Task::(_updateState) Task=`d04baeda-9af4-4cd1-b343-b8bbce33bdc2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:09:32,726::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:09:32,727::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:09:32,728::task::990::TaskManager.Task::(_decref) Task=`d04baeda-9af4-4cd1-b343-b8bbce33bdc2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:09:32,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.113141 s, 9.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:34,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:34,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564201 s, 18.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:37,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:38,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.31551 s, 778 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:09:40,778::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-13::DEBUG::2014-08-21 12:09:40,779::task::595::TaskManager.Task::(_updateState) Task=`98f226bc-40c5-4903-a3a3-d6eab1350cfc`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:09:40,780::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:09:40,780::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:09:40,780::task::1185::TaskManager.Task::(prepare) Task=`98f226bc-40c5-4903-a3a3-d6eab1350cfc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:09:40,781::task::595::TaskManager.Task::(_updateState) Task=`98f226bc-40c5-4903-a3a3-d6eab1350cfc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:09:40,781::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:09:40,781::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:09:40,782::task::990::TaskManager.Task::(_decref) Task=`98f226bc-40c5-4903-a3a3-d6eab1350cfc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:09:40,786::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-34::DEBUG::2014-08-21 12:09:40,787::task::595::TaskManager.Task::(_updateState) Task=`de397b9b-e713-4a94-822a-cd485ebec5c6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:09:40,787::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:09:40,788::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ccf325d8-7f01-4b33-98fe-dc10d9d0c253`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:09:40,789::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:09:40,789::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:09:40,789::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ccf325d8-7f01-4b33-98fe-dc10d9d0c253`::Granted request
>Thread-34::DEBUG::2014-08-21 12:09:40,790::task::827::TaskManager.Task::(resourceAcquired) Task=`de397b9b-e713-4a94-822a-cd485ebec5c6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:09:40,790::task::990::TaskManager.Task::(_decref) Task=`de397b9b-e713-4a94-822a-cd485ebec5c6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:09:40,794::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967170560', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:40,795::task::1185::TaskManager.Task::(prepare) Task=`de397b9b-e713-4a94-822a-cd485ebec5c6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967170560', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:40,795::task::595::TaskManager.Task::(_updateState) Task=`de397b9b-e713-4a94-822a-cd485ebec5c6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:09:40,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:09:40,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:09:40,796::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:09:40,796::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:09:40,796::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:09:40,796::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:09:40,796::task::990::TaskManager.Task::(_decref) Task=`de397b9b-e713-4a94-822a-cd485ebec5c6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:09:41,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:41,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0799731 s, 12.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:09:42,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:09:42,058::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00177093 s, 281 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:43,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:44,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.767583 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:46,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:46,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.254173 s, 4.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:09:48,105::task::595::TaskManager.Task::(_updateState) Task=`17d335eb-cc13-4250-9827-67e9fbfe0247`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:09:48,106::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:09:48,106::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00177093', 'lastCheck': '6.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:09:48,106::task::1185::TaskManager.Task::(prepare) Task=`17d335eb-cc13-4250-9827-67e9fbfe0247`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00177093', 'lastCheck': '6.0', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:09:48,107::task::595::TaskManager.Task::(_updateState) Task=`17d335eb-cc13-4250-9827-67e9fbfe0247`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:09:48,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:09:48,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:09:48,107::task::990::TaskManager.Task::(_decref) Task=`17d335eb-cc13-4250-9827-67e9fbfe0247`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:09:48,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:49,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.202749 s, 5.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:09:50,810::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-13::DEBUG::2014-08-21 12:09:50,812::task::595::TaskManager.Task::(_updateState) Task=`59277cab-d893-46b6-b5a1-469f7d27c39a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:09:50,812::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:09:50,813::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:09:50,813::task::1185::TaskManager.Task::(prepare) Task=`59277cab-d893-46b6-b5a1-469f7d27c39a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:09:50,814::task::595::TaskManager.Task::(_updateState) Task=`59277cab-d893-46b6-b5a1-469f7d27c39a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:09:50,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:09:50,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:09:50,815::task::990::TaskManager.Task::(_decref) Task=`59277cab-d893-46b6-b5a1-469f7d27c39a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:09:50,825::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [bd24b9e]
>Thread-34::DEBUG::2014-08-21 12:09:50,828::task::595::TaskManager.Task::(_updateState) Task=`1869edfd-850a-4f88-a75c-7d3ddeb05315`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:09:50,828::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:09:50,830::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5e8065d5-aec6-48c2-82c2-0f190d430497`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:09:50,830::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:09:50,831::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:09:50,831::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5e8065d5-aec6-48c2-82c2-0f190d430497`::Granted request
>Thread-34::DEBUG::2014-08-21 12:09:50,832::task::827::TaskManager.Task::(resourceAcquired) Task=`1869edfd-850a-4f88-a75c-7d3ddeb05315`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:09:50,833::task::990::TaskManager.Task::(_decref) Task=`1869edfd-850a-4f88-a75c-7d3ddeb05315`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:09:50,843::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:50,844::task::1185::TaskManager.Task::(prepare) Task=`1869edfd-850a-4f88-a75c-7d3ddeb05315`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:09:50,845::task::595::TaskManager.Task::(_updateState) Task=`1869edfd-850a-4f88-a75c-7d3ddeb05315`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:09:50,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:09:50,845::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:09:50,846::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:09:50,847::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:09:50,847::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:09:50,847::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:09:50,848::task::990::TaskManager.Task::(_decref) Task=`1869edfd-850a-4f88-a75c-7d3ddeb05315`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:09:51,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:51,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101306 s, 10.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:09:52,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:09:52,175::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00388044 s, 128 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:53,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:53,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0729941 s, 14.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:09:55,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:09:58,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.771607 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:10:00,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:10:00,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.152531 s, 6.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:10:00,869::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-13::DEBUG::2014-08-21 12:10:00,871::task::595::TaskManager.Task::(_updateState) Task=`540c4b5d-8621-4c55-ba0c-86f590aaa86f`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:10:00,871::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:10:00,872::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:10:00,873::task::1185::TaskManager.Task::(prepare) Task=`540c4b5d-8621-4c55-ba0c-86f590aaa86f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:10:00,874::task::595::TaskManager.Task::(_updateState) Task=`540c4b5d-8621-4c55-ba0c-86f590aaa86f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:10:00,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:10:00,874::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:10:00,874::task::990::TaskManager.Task::(_decref) Task=`540c4b5d-8621-4c55-ba0c-86f590aaa86f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:10:00,887::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [42d8a38d]
>Thread-34::DEBUG::2014-08-21 12:10:00,888::task::595::TaskManager.Task::(_updateState) Task=`38a939b3-7fda-4fc9-9654-0e7a8c963238`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:10:00,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:10:00,889::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0515a2ea-091f-4a76-8236-0bb327e3fe31`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:10:00,890::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:10:00,890::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:10:00,890::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0515a2ea-091f-4a76-8236-0bb327e3fe31`::Granted request
>Thread-34::DEBUG::2014-08-21 12:10:00,891::task::827::TaskManager.Task::(resourceAcquired) Task=`38a939b3-7fda-4fc9-9654-0e7a8c963238`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:10:00,891::task::990::TaskManager.Task::(_decref) Task=`38a939b3-7fda-4fc9-9654-0e7a8c963238`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:10:00,897::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:10:00,898::task::1185::TaskManager.Task::(prepare) Task=`38a939b3-7fda-4fc9-9654-0e7a8c963238`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:10:00,898::task::595::TaskManager.Task::(_updateState) Task=`38a939b3-7fda-4fc9-9654-0e7a8c963238`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:10:00,898::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:10:00,898::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:10:00,899::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:10:00,899::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:10:00,900::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:10:00,900::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:10:00,900::task::990::TaskManager.Task::(_decref) Task=`38a939b3-7fda-4fc9-9654-0e7a8c963238`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:10:02,626::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:10:45,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:10:45,259::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.305284 s, 1.6 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:10:46,549::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 12:10:46,554::task::595::TaskManager.Task::(_updateState) Task=`c4df9655-9424-457c-a33b-9fa673e68a20`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:10:51,998::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:10:52,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00388044', 'lastCheck': '59.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:10:52,326::task::595::TaskManager.Task::(_updateState) Task=`fde3e2ab-4c1b-4c26-951e-85452a4e4711`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:10:52,327::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:10:52,328::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:10:52,329::task::1185::TaskManager.Task::(prepare) Task=`fde3e2ab-4c1b-4c26-951e-85452a4e4711`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:10:52,329::task::595::TaskManager.Task::(_updateState) Task=`fde3e2ab-4c1b-4c26-951e-85452a4e4711`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:10:52,330::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:10:52,330::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:10:52,331::task::990::TaskManager.Task::(_decref) Task=`fde3e2ab-4c1b-4c26-951e-85452a4e4711`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:10:52,440::task::1185::TaskManager.Task::(prepare) Task=`c4df9655-9424-457c-a33b-9fa673e68a20`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00388044', 'lastCheck': '59.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:10:52,480::task::595::TaskManager.Task::(_updateState) Task=`c4df9655-9424-457c-a33b-9fa673e68a20`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:10:52,481::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:10:52,481::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:10:52,482::task::990::TaskManager.Task::(_decref) Task=`c4df9655-9424-457c-a33b-9fa673e68a20`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:10:55,784::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 12:10:55,787::task::595::TaskManager.Task::(_updateState) Task=`c8ddb6dd-5267-46ba-8311-24988b62f834`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:10:55,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:10:55,791::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d9d6c85f-8831-4dcd-966c-5bfd6dc0baab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:10:55,792::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:10:55,792::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:10:55,793::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d9d6c85f-8831-4dcd-966c-5bfd6dc0baab`::Granted request
>Thread-34::DEBUG::2014-08-21 12:10:55,796::task::827::TaskManager.Task::(resourceAcquired) Task=`c8ddb6dd-5267-46ba-8311-24988b62f834`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:10:55,796::task::990::TaskManager.Task::(_decref) Task=`c8ddb6dd-5267-46ba-8311-24988b62f834`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:10:55,803::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:10:55,803::task::1185::TaskManager.Task::(prepare) Task=`c8ddb6dd-5267-46ba-8311-24988b62f834`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:10:55,803::task::595::TaskManager.Task::(_updateState) Task=`c8ddb6dd-5267-46ba-8311-24988b62f834`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:10:55,804::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:10:55,804::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:10:55,805::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:10:55,805::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:10:55,806::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:10:55,806::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:10:55,807::task::990::TaskManager.Task::(_decref) Task=`c8ddb6dd-5267-46ba-8311-24988b62f834`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:10:55,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.83998 s, 267 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:10:57,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:10:58,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.518256 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:00,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:01,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0558024 s, 18.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:03,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:03,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0912103 s, 11.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:05,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:05,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.117749 s, 8.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:11:05,825::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-13::DEBUG::2014-08-21 12:11:05,827::task::595::TaskManager.Task::(_updateState) Task=`7ebfbc9b-4e7e-4d3e-97a6-482e6f18ef0c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:11:05,827::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:11:05,828::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:11:05,828::task::1185::TaskManager.Task::(prepare) Task=`7ebfbc9b-4e7e-4d3e-97a6-482e6f18ef0c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:11:05,829::task::595::TaskManager.Task::(_updateState) Task=`7ebfbc9b-4e7e-4d3e-97a6-482e6f18ef0c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:11:05,829::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:11:05,829::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:11:05,830::task::990::TaskManager.Task::(_decref) Task=`7ebfbc9b-4e7e-4d3e-97a6-482e6f18ef0c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:11:06,425::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4b392fd4]
>Thread-34::DEBUG::2014-08-21 12:11:06,529::task::595::TaskManager.Task::(_updateState) Task=`13b6f01b-5b43-4483-a54d-32017ce21f8e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:11:06,529::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:11:06,531::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f53eccf1-aa29-4cc2-9ef0-59fb638bb365`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:11:06,531::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:11:06,532::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:11:06,532::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f53eccf1-aa29-4cc2-9ef0-59fb638bb365`::Granted request
>Thread-34::DEBUG::2014-08-21 12:11:06,533::task::827::TaskManager.Task::(resourceAcquired) Task=`13b6f01b-5b43-4483-a54d-32017ce21f8e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:11:06,533::task::990::TaskManager.Task::(_decref) Task=`13b6f01b-5b43-4483-a54d-32017ce21f8e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:11:06,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:06,747::task::1185::TaskManager.Task::(prepare) Task=`13b6f01b-5b43-4483-a54d-32017ce21f8e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:06,748::task::595::TaskManager.Task::(_updateState) Task=`13b6f01b-5b43-4483-a54d-32017ce21f8e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:11:06,748::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:11:06,748::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:11:06,749::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:11:06,749::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:11:06,750::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:11:06,750::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:11:06,750::task::990::TaskManager.Task::(_decref) Task=`13b6f01b-5b43-4483-a54d-32017ce21f8e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:11:08,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:08,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0623283 s, 16.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:10,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:11:12,106::task::595::TaskManager.Task::(_updateState) Task=`198e52d2-e0d4-4e1a-94f0-976e48134dfa`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:11:12,106::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:11:12,107::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.305284', 'lastCheck': '8.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:11:12,112::task::1185::TaskManager.Task::(prepare) Task=`198e52d2-e0d4-4e1a-94f0-976e48134dfa`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.305284', 'lastCheck': '8.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:11:12,126::task::595::TaskManager.Task::(_updateState) Task=`198e52d2-e0d4-4e1a-94f0-976e48134dfa`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:11:12,139::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:11:12,140::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:11:12,140::task::990::TaskManager.Task::(_decref) Task=`198e52d2-e0d4-4e1a-94f0-976e48134dfa`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:11:12,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.15885 s, 884 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:11:14,124::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:14,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:11:14,426::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00181811 s, 274 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:14,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0795497 s, 12.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:16,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:11:25,081::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [255ff494]
>Thread-26::DEBUG::2014-08-21 12:11:25,082::task::595::TaskManager.Task::(_updateState) Task=`b7a134f8-ce0d-46f5-beea-08bcd25a6b1b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:11:25,083::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:11:25,083::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:11:25,084::task::1185::TaskManager.Task::(prepare) Task=`b7a134f8-ce0d-46f5-beea-08bcd25a6b1b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:11:25,084::task::595::TaskManager.Task::(_updateState) Task=`b7a134f8-ce0d-46f5-beea-08bcd25a6b1b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:11:25,084::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:11:25,084::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:11:25,085::task::990::TaskManager.Task::(_decref) Task=`b7a134f8-ce0d-46f5-beea-08bcd25a6b1b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:11:25,098::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:11:25,159::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000498907 s, 998 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:11:25,165::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [255ff494]
>Thread-34::DEBUG::2014-08-21 12:11:25,167::task::595::TaskManager.Task::(_updateState) Task=`ff2eb266-ece0-4e4f-8073-c898e9d6ddef`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:11:25,168::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:11:25,170::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`34b2fe6f-f4e3-4748-9265-86ed778c1690`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:11:25,170::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:11:25,172::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:11:25,172::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`34b2fe6f-f4e3-4748-9265-86ed778c1690`::Granted request
>Thread-34::DEBUG::2014-08-21 12:11:25,174::task::827::TaskManager.Task::(resourceAcquired) Task=`ff2eb266-ece0-4e4f-8073-c898e9d6ddef`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:11:25,174::task::990::TaskManager.Task::(_decref) Task=`ff2eb266-ece0-4e4f-8073-c898e9d6ddef`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:11:25,434::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:25,437::task::1185::TaskManager.Task::(prepare) Task=`ff2eb266-ece0-4e4f-8073-c898e9d6ddef`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:25,437::task::595::TaskManager.Task::(_updateState) Task=`ff2eb266-ece0-4e4f-8073-c898e9d6ddef`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:11:25,447::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:11:26,078::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:11:26,125::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:11:26,126::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:11:26,127::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:11:26,127::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:11:26,128::task::990::TaskManager.Task::(_decref) Task=`ff2eb266-ece0-4e4f-8073-c898e9d6ddef`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:11:31,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 12.1049 s, 84.6 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:33,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:11:34,390::task::595::TaskManager.Task::(_updateState) Task=`a178ce4e-aba3-4eb8-832d-0cf3404ccd20`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:11:34,391::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:11:34,392::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498907', 'lastCheck': '7.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:11:34,392::task::1185::TaskManager.Task::(prepare) Task=`a178ce4e-aba3-4eb8-832d-0cf3404ccd20`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498907', 'lastCheck': '7.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:11:34,393::task::595::TaskManager.Task::(_updateState) Task=`a178ce4e-aba3-4eb8-832d-0cf3404ccd20`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:11:34,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:11:34,451::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:11:34,596::task::990::TaskManager.Task::(_decref) Task=`a178ce4e-aba3-4eb8-832d-0cf3404ccd20`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:11:36,923::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:11:36,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0010514 s, 474 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:36,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.30002 s, 788 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:11:38,077::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-26::DEBUG::2014-08-21 12:11:38,079::task::595::TaskManager.Task::(_updateState) Task=`39135960-4a96-424a-be6d-a59d169c208c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:11:38,079::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:11:38,080::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:11:38,080::task::1185::TaskManager.Task::(prepare) Task=`39135960-4a96-424a-be6d-a59d169c208c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:11:38,080::task::595::TaskManager.Task::(_updateState) Task=`39135960-4a96-424a-be6d-a59d169c208c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:11:38,081::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:11:38,081::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:11:38,081::task::990::TaskManager.Task::(_decref) Task=`39135960-4a96-424a-be6d-a59d169c208c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:11:38,101::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5c101247]
>Thread-34::DEBUG::2014-08-21 12:11:38,102::task::595::TaskManager.Task::(_updateState) Task=`e5503cd9-fd68-4c16-ba11-5ffca414ffeb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:11:38,102::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:11:38,103::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c065a7b1-d5b9-4c3f-abca-40c5e44826eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:11:38,103::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:11:38,104::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:11:38,104::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c065a7b1-d5b9-4c3f-abca-40c5e44826eb`::Granted request
>Thread-34::DEBUG::2014-08-21 12:11:38,105::task::827::TaskManager.Task::(resourceAcquired) Task=`e5503cd9-fd68-4c16-ba11-5ffca414ffeb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:11:38,105::task::990::TaskManager.Task::(_decref) Task=`e5503cd9-fd68-4c16-ba11-5ffca414ffeb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:11:38,111::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:38,112::task::1185::TaskManager.Task::(prepare) Task=`e5503cd9-fd68-4c16-ba11-5ffca414ffeb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:38,112::task::595::TaskManager.Task::(_updateState) Task=`e5503cd9-fd68-4c16-ba11-5ffca414ffeb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:11:38,113::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:11:38,131::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:11:38,132::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:11:38,133::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:11:38,133::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:11:38,133::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:11:38,134::task::990::TaskManager.Task::(_decref) Task=`e5503cd9-fd68-4c16-ba11-5ffca414ffeb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:11:38,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:39,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.12315 s, 8.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:41,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:41,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0704155 s, 14.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:43,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:43,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100205 s, 10.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:45,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:45,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0722299 s, 14.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:11:47,311::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:11:47,368::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0306711 s, 16.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:47,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:48,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116594 s, 8.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:11:48,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-26::DEBUG::2014-08-21 12:11:48,174::task::595::TaskManager.Task::(_updateState) Task=`6dd23698-f900-4145-bfbc-c8ea30abd38d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:11:48,175::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:11:48,175::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:11:48,175::task::1185::TaskManager.Task::(prepare) Task=`6dd23698-f900-4145-bfbc-c8ea30abd38d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:11:48,176::task::595::TaskManager.Task::(_updateState) Task=`6dd23698-f900-4145-bfbc-c8ea30abd38d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:11:48,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:11:48,176::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:11:48,176::task::990::TaskManager.Task::(_decref) Task=`6dd23698-f900-4145-bfbc-c8ea30abd38d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:11:48,183::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [239bde8f]
>Thread-34::DEBUG::2014-08-21 12:11:48,183::task::595::TaskManager.Task::(_updateState) Task=`642d70fb-9e16-4645-9b1c-e8fa67e6f3c9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:11:48,184::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:11:48,184::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`16e254b0-3fa4-4671-ac99-5eba8667d94d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:11:48,185::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:11:48,185::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:11:48,186::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`16e254b0-3fa4-4671-ac99-5eba8667d94d`::Granted request
>Thread-34::DEBUG::2014-08-21 12:11:48,186::task::827::TaskManager.Task::(resourceAcquired) Task=`642d70fb-9e16-4645-9b1c-e8fa67e6f3c9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:11:48,186::task::990::TaskManager.Task::(_decref) Task=`642d70fb-9e16-4645-9b1c-e8fa67e6f3c9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:11:48,192::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:48,193::task::1185::TaskManager.Task::(prepare) Task=`642d70fb-9e16-4645-9b1c-e8fa67e6f3c9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:48,193::task::595::TaskManager.Task::(_updateState) Task=`642d70fb-9e16-4645-9b1c-e8fa67e6f3c9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:11:48,193::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:11:48,194::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:11:48,194::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:11:48,194::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:11:48,195::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:11:48,195::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:11:48,195::task::990::TaskManager.Task::(_decref) Task=`642d70fb-9e16-4645-9b1c-e8fa67e6f3c9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:11:50,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:50,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.166577 s, 6.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:11:51,128::task::595::TaskManager.Task::(_updateState) Task=`37b86834-0f1a-4b3a-a6f9-ac694bd6cde5`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:11:51,134::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:11:51,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0306711', 'lastCheck': '3.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:11:51,138::task::1185::TaskManager.Task::(prepare) Task=`37b86834-0f1a-4b3a-a6f9-ac694bd6cde5`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0306711', 'lastCheck': '3.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:11:51,141::task::595::TaskManager.Task::(_updateState) Task=`37b86834-0f1a-4b3a-a6f9-ac694bd6cde5`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:11:51,145::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:11:51,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:11:51,632::task::990::TaskManager.Task::(_decref) Task=`37b86834-0f1a-4b3a-a6f9-ac694bd6cde5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:11:52,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:55,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.74116 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:11:57,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:57,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.273217 s, 3.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:11:57,827::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:11:57,866::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00117672 s, 423 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:11:58,210::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-26::DEBUG::2014-08-21 12:11:58,212::task::595::TaskManager.Task::(_updateState) Task=`ad2e6163-6e05-47a1-b0d5-2f3422de1dfa`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:11:58,212::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:11:58,213::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:11:58,213::task::1185::TaskManager.Task::(prepare) Task=`ad2e6163-6e05-47a1-b0d5-2f3422de1dfa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:11:58,214::task::595::TaskManager.Task::(_updateState) Task=`ad2e6163-6e05-47a1-b0d5-2f3422de1dfa`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:11:58,214::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:11:58,214::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:11:58,215::task::990::TaskManager.Task::(_decref) Task=`ad2e6163-6e05-47a1-b0d5-2f3422de1dfa`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:11:58,239::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 12:11:58,240::task::595::TaskManager.Task::(_updateState) Task=`f53c6c14-df45-4ef0-9e5b-e9249a9c0f39`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:11:58,240::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:11:58,242::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`70f12059-82f0-4e0b-9b4c-8d86dd78b9ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:11:58,242::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:11:58,243::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:11:58,243::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`70f12059-82f0-4e0b-9b4c-8d86dd78b9ac`::Granted request
>Thread-34::DEBUG::2014-08-21 12:11:58,263::task::827::TaskManager.Task::(resourceAcquired) Task=`f53c6c14-df45-4ef0-9e5b-e9249a9c0f39`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:11:58,264::task::990::TaskManager.Task::(_decref) Task=`f53c6c14-df45-4ef0-9e5b-e9249a9c0f39`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:11:58,269::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:58,270::task::1185::TaskManager.Task::(prepare) Task=`f53c6c14-df45-4ef0-9e5b-e9249a9c0f39`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:11:58,270::task::595::TaskManager.Task::(_updateState) Task=`f53c6c14-df45-4ef0-9e5b-e9249a9c0f39`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:11:58,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:11:58,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:11:58,271::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:11:58,272::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:11:58,272::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:11:58,272::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:11:58,272::task::990::TaskManager.Task::(_decref) Task=`f53c6c14-df45-4ef0-9e5b-e9249a9c0f39`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:11:59,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:11:59,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0827614 s, 12.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:01,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:02,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.192982 s, 5.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:04,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:04,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0525697 s, 19.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:06,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:06,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.132177 s, 7.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:12:07,902::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:12:07,921::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00189945 s, 262 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:12:08,298::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-26::DEBUG::2014-08-21 12:12:08,299::task::595::TaskManager.Task::(_updateState) Task=`41a26122-0c9a-4acd-8bc7-7a3718ef6fda`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:12:08,300::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:12:08,300::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:12:08,301::task::1185::TaskManager.Task::(prepare) Task=`41a26122-0c9a-4acd-8bc7-7a3718ef6fda`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:12:08,301::task::595::TaskManager.Task::(_updateState) Task=`41a26122-0c9a-4acd-8bc7-7a3718ef6fda`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:12:08,301::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:12:08,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:12:08,302::task::990::TaskManager.Task::(_decref) Task=`41a26122-0c9a-4acd-8bc7-7a3718ef6fda`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:12:08,312::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-34::DEBUG::2014-08-21 12:12:08,313::task::595::TaskManager.Task::(_updateState) Task=`27c073eb-eec7-42bf-8ad7-8fcaf512bded`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:12:08,314::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:12:08,315::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`55e4b254-245e-417c-95d3-7a0525b3e5d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:12:08,315::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:12:08,315::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:12:08,315::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`55e4b254-245e-417c-95d3-7a0525b3e5d1`::Granted request
>Thread-34::DEBUG::2014-08-21 12:12:08,316::task::827::TaskManager.Task::(resourceAcquired) Task=`27c073eb-eec7-42bf-8ad7-8fcaf512bded`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:12:08,316::task::990::TaskManager.Task::(_decref) Task=`27c073eb-eec7-42bf-8ad7-8fcaf512bded`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:12:08,321::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:08,321::task::1185::TaskManager.Task::(prepare) Task=`27c073eb-eec7-42bf-8ad7-8fcaf512bded`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:08,321::task::595::TaskManager.Task::(_updateState) Task=`27c073eb-eec7-42bf-8ad7-8fcaf512bded`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:12:08,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:12:08,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:12:08,323::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:12:08,323::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:12:08,324::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:12:08,324::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:12:08,324::task::990::TaskManager.Task::(_decref) Task=`27c073eb-eec7-42bf-8ad7-8fcaf512bded`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:12:08,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:12:09,524::task::595::TaskManager.Task::(_updateState) Task=`7febd625-e5bf-49b6-8063-dd4f25a1110d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:12:09,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:12:09,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00189945', 'lastCheck': '1.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:12:09,526::task::1185::TaskManager.Task::(prepare) Task=`7febd625-e5bf-49b6-8063-dd4f25a1110d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00189945', 'lastCheck': '1.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:12:09,527::task::595::TaskManager.Task::(_updateState) Task=`7febd625-e5bf-49b6-8063-dd4f25a1110d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:12:09,527::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:12:09,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:12:09,528::task::990::TaskManager.Task::(_decref) Task=`7febd625-e5bf-49b6-8063-dd4f25a1110d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:12:09,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.681374 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:11,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:13,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.16977 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:15,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:15,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0696661 s, 14.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:17,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:17,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.126598 s, 8.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:12:17,947::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:12:17,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000563112 s, 884 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:12:18,346::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2d92e2f2]
>Thread-26::DEBUG::2014-08-21 12:12:18,347::task::595::TaskManager.Task::(_updateState) Task=`9dc204a7-7fac-42d2-9117-74354944cedc`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:12:18,348::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:12:18,348::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:12:18,348::task::1185::TaskManager.Task::(prepare) Task=`9dc204a7-7fac-42d2-9117-74354944cedc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:12:18,348::task::595::TaskManager.Task::(_updateState) Task=`9dc204a7-7fac-42d2-9117-74354944cedc`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:12:18,349::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:12:18,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:12:18,349::task::990::TaskManager.Task::(_decref) Task=`9dc204a7-7fac-42d2-9117-74354944cedc`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:12:18,354::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2d92e2f2]
>Thread-34::DEBUG::2014-08-21 12:12:18,354::task::595::TaskManager.Task::(_updateState) Task=`ab209f8e-d958-47d8-8b55-8aa5f01a66a6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:12:18,355::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:12:18,355::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c9172724-628e-4cf1-8616-57d6675d51c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:12:18,356::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:12:18,356::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:12:18,356::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c9172724-628e-4cf1-8616-57d6675d51c8`::Granted request
>Thread-34::DEBUG::2014-08-21 12:12:18,358::task::827::TaskManager.Task::(resourceAcquired) Task=`ab209f8e-d958-47d8-8b55-8aa5f01a66a6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:12:18,358::task::990::TaskManager.Task::(_decref) Task=`ab209f8e-d958-47d8-8b55-8aa5f01a66a6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:12:18,364::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:18,364::task::1185::TaskManager.Task::(prepare) Task=`ab209f8e-d958-47d8-8b55-8aa5f01a66a6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:18,364::task::595::TaskManager.Task::(_updateState) Task=`ab209f8e-d958-47d8-8b55-8aa5f01a66a6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:12:18,365::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:12:18,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:12:18,366::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:12:18,366::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:12:18,366::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:12:18,367::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:12:18,367::task::990::TaskManager.Task::(_decref) Task=`ab209f8e-d958-47d8-8b55-8aa5f01a66a6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:12:19,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:19,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.149406 s, 6.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:21,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:22,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.18818 s, 5.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:24,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:24,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103074 s, 9.9 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:12:24,848::task::595::TaskManager.Task::(_updateState) Task=`1951ee51-3842-4f03-9130-de869a3fd1aa`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:12:24,849::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:12:24,849::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563112', 'lastCheck': '6.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:12:24,850::task::1185::TaskManager.Task::(prepare) Task=`1951ee51-3842-4f03-9130-de869a3fd1aa`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563112', 'lastCheck': '6.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:12:24,850::task::595::TaskManager.Task::(_updateState) Task=`1951ee51-3842-4f03-9130-de869a3fd1aa`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:12:24,850::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:12:24,851::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:12:24,851::task::990::TaskManager.Task::(_decref) Task=`1951ee51-3842-4f03-9130-de869a3fd1aa`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:12:26,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:26,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.238312 s, 4.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:28,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:12:29,828::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-13::DEBUG::2014-08-21 12:12:29,829::task::595::TaskManager.Task::(_updateState) Task=`12d6df97-352b-45ea-aa23-2756dd545323`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:12:29,830::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:12:29,854::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:12:29,855::task::1185::TaskManager.Task::(prepare) Task=`12d6df97-352b-45ea-aa23-2756dd545323`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:12:29,855::task::595::TaskManager.Task::(_updateState) Task=`12d6df97-352b-45ea-aa23-2756dd545323`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:12:29,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:12:29,856::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:12:29,856::task::990::TaskManager.Task::(_decref) Task=`12d6df97-352b-45ea-aa23-2756dd545323`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:12:30,105::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:12:30,281::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-34::DEBUG::2014-08-21 12:12:30,308::task::595::TaskManager.Task::(_updateState) Task=`3ecc0e46-1aa2-456f-9db5-55e14e10604e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:12:30,309::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:12:30,315::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3ec7d082-e193-460e-908b-97085b441938`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:12:30,315::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:12:30,316::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:12:30,316::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3ec7d082-e193-460e-908b-97085b441938`::Granted request
>Thread-34::DEBUG::2014-08-21 12:12:30,318::task::827::TaskManager.Task::(resourceAcquired) Task=`3ecc0e46-1aa2-456f-9db5-55e14e10604e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:12:30,324::task::990::TaskManager.Task::(_decref) Task=`3ecc0e46-1aa2-456f-9db5-55e14e10604e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:12:30,411::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:30,412::task::1185::TaskManager.Task::(prepare) Task=`3ecc0e46-1aa2-456f-9db5-55e14e10604e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:30,412::task::595::TaskManager.Task::(_updateState) Task=`3ecc0e46-1aa2-456f-9db5-55e14e10604e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:12:30,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:12:30,414::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:12:30,432::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:12:30,433::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:12:30,433::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:12:30,433::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:12:30,434::task::990::TaskManager.Task::(_decref) Task=`3ecc0e46-1aa2-456f-9db5-55e14e10604e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:12:30,479::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0124995 s, 39.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:31,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.68453 s, 608 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:33,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:33,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0549057 s, 18.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:35,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:35,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.167434 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:37,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:12:43,392::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-26::DEBUG::2014-08-21 12:12:43,508::task::595::TaskManager.Task::(_updateState) Task=`cd622f22-6ed7-49ce-8800-6ebc220fd496`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:12:43,510::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:12:43,511::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:12:43,512::task::1185::TaskManager.Task::(prepare) Task=`cd622f22-6ed7-49ce-8800-6ebc220fd496`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:12:43,512::task::595::TaskManager.Task::(_updateState) Task=`cd622f22-6ed7-49ce-8800-6ebc220fd496`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:12:43,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:12:43,513::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:12:43,513::task::990::TaskManager.Task::(_decref) Task=`cd622f22-6ed7-49ce-8800-6ebc220fd496`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:12:43,769::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:12:44,101::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-15::DEBUG::2014-08-21 12:12:44,414::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0701113 s, 7.1 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:12:44,820::task::595::TaskManager.Task::(_updateState) Task=`829db9c8-c625-47c8-b8e8-7c2b2af4d6db`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:12:44,887::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:12:45,590::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e2903198-d0d0-4eaf-a01e-4cab344524ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:12:45,591::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:12:45,591::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:12:45,592::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e2903198-d0d0-4eaf-a01e-4cab344524ec`::Granted request
>Thread-34::DEBUG::2014-08-21 12:12:45,612::task::827::TaskManager.Task::(resourceAcquired) Task=`829db9c8-c625-47c8-b8e8-7c2b2af4d6db`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:12:45,613::task::990::TaskManager.Task::(_decref) Task=`829db9c8-c625-47c8-b8e8-7c2b2af4d6db`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:12:46,939::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967170560', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:46,940::task::1185::TaskManager.Task::(prepare) Task=`829db9c8-c625-47c8-b8e8-7c2b2af4d6db`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967170560', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:46,945::task::595::TaskManager.Task::(_updateState) Task=`829db9c8-c625-47c8-b8e8-7c2b2af4d6db`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:12:46,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:12:46,974::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:12:47,003::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:12:47,004::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:12:47,004::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:12:47,005::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:12:47,014::task::990::TaskManager.Task::(_decref) Task=`829db9c8-c625-47c8-b8e8-7c2b2af4d6db`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:12:47,419::task::595::TaskManager.Task::(_updateState) Task=`ad1b587b-0315-4f5f-9e66-e9eb3563b9f3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:12:47,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:12:47,500::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0701113', 'lastCheck': '1.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:12:47,509::task::1185::TaskManager.Task::(prepare) Task=`ad1b587b-0315-4f5f-9e66-e9eb3563b9f3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0701113', 'lastCheck': '1.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:12:47,519::task::595::TaskManager.Task::(_updateState) Task=`ad1b587b-0315-4f5f-9e66-e9eb3563b9f3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:12:47,525::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:12:47,588::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:12:47,594::task::990::TaskManager.Task::(_decref) Task=`ad1b587b-0315-4f5f-9e66-e9eb3563b9f3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:12:48,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.07728 s, 127 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:50,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:52,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.356939 s, 2.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:54,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:12:55,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.567099 s, 1.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:12:56,635::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:12:56,663::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0013519 s, 368 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:12:57,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:12:57,532::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-26::DEBUG::2014-08-21 12:12:57,536::task::595::TaskManager.Task::(_updateState) Task=`98efd050-ae27-42a4-91b1-d058a715bc9a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:12:57,538::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:12:57,539::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:12:57,550::task::1185::TaskManager.Task::(prepare) Task=`98efd050-ae27-42a4-91b1-d058a715bc9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:12:57,551::task::595::TaskManager.Task::(_updateState) Task=`98efd050-ae27-42a4-91b1-d058a715bc9a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:12:57,552::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:12:57,552::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:12:57,553::task::990::TaskManager.Task::(_decref) Task=`98efd050-ae27-42a4-91b1-d058a715bc9a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:12:57,560::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [710e9cbf]
>Thread-34::DEBUG::2014-08-21 12:12:57,562::task::595::TaskManager.Task::(_updateState) Task=`3351e8ab-92a6-4746-a177-4ace9cfdc504`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:12:57,563::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:12:57,564::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`58bd60d0-be0d-4467-8106-0fcf4ccc7c86`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:12:57,565::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:12:57,566::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:12:57,566::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`58bd60d0-be0d-4467-8106-0fcf4ccc7c86`::Granted request
>Thread-34::DEBUG::2014-08-21 12:12:57,567::task::827::TaskManager.Task::(resourceAcquired) Task=`3351e8ab-92a6-4746-a177-4ace9cfdc504`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:12:57,567::task::990::TaskManager.Task::(_decref) Task=`3351e8ab-92a6-4746-a177-4ace9cfdc504`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:12:57,576::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:57,577::task::1185::TaskManager.Task::(prepare) Task=`3351e8ab-92a6-4746-a177-4ace9cfdc504`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:12:57,577::task::595::TaskManager.Task::(_updateState) Task=`3351e8ab-92a6-4746-a177-4ace9cfdc504`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:12:57,577::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:12:57,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:12:57,578::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:12:57,579::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:12:57,579::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:12:57,580::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:12:57,580::task::990::TaskManager.Task::(_decref) Task=`3351e8ab-92a6-4746-a177-4ace9cfdc504`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:12:58,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.864298 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:00,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:01,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.23307 s, 830 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:03,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:13:05,372::task::595::TaskManager.Task::(_updateState) Task=`6e7a27ec-2995-4d81-af99-20abf89a97d6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:05,375::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:13:05,375::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0013519', 'lastCheck': '8.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:13:05,375::task::1185::TaskManager.Task::(prepare) Task=`6e7a27ec-2995-4d81-af99-20abf89a97d6`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0013519', 'lastCheck': '8.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:13:05,376::task::595::TaskManager.Task::(_updateState) Task=`6e7a27ec-2995-4d81-af99-20abf89a97d6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:05,377::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:05,378::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:05,379::task::990::TaskManager.Task::(_decref) Task=`6e7a27ec-2995-4d81-af99-20abf89a97d6`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:13:05,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.69134 s, 605 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:13:06,726::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:13:06,755::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:13:06,766::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-26::DEBUG::2014-08-21 12:13:07,883::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-26::DEBUG::2014-08-21 12:13:07,885::task::595::TaskManager.Task::(_updateState) Task=`08e39809-cd95-45ce-b2d8-0a5f1a2e6b03`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:07,899::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 12:13:07,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:13:07,966::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 12:13:07,970::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 12:13:07,970::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 12:13:07,970::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-26::INFO::2014-08-21 12:13:07,971::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:07,972::task::1185::TaskManager.Task::(prepare) Task=`08e39809-cd95-45ce-b2d8-0a5f1a2e6b03`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:07,972::task::595::TaskManager.Task::(_updateState) Task=`08e39809-cd95-45ce-b2d8-0a5f1a2e6b03`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:07,972::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:07,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:07,973::task::990::TaskManager.Task::(_decref) Task=`08e39809-cd95-45ce-b2d8-0a5f1a2e6b03`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:13:08,025::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 12:13:08,030::task::595::TaskManager.Task::(_updateState) Task=`09e012d6-b7bb-48f7-a228-6a672976dc2b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:13:08,030::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:13:08,031::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`44c900aa-2169-4a60-8777-d3e5ff61baa6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:13:08,031::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:13:08,032::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:13:08,033::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`44c900aa-2169-4a60-8777-d3e5ff61baa6`::Granted request
>Thread-34::DEBUG::2014-08-21 12:13:08,033::task::827::TaskManager.Task::(resourceAcquired) Task=`09e012d6-b7bb-48f7-a228-6a672976dc2b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:13:08,034::task::990::TaskManager.Task::(_decref) Task=`09e012d6-b7bb-48f7-a228-6a672976dc2b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:13:08,039::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:08,039::task::1185::TaskManager.Task::(prepare) Task=`09e012d6-b7bb-48f7-a228-6a672976dc2b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:08,040::task::595::TaskManager.Task::(_updateState) Task=`09e012d6-b7bb-48f7-a228-6a672976dc2b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:13:08,040::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:13:08,041::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:13:08,041::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:13:08,041::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:13:08,042::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:13:08,042::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:13:08,042::task::990::TaskManager.Task::(_decref) Task=`09e012d6-b7bb-48f7-a228-6a672976dc2b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:13:08,060::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:13:08,114::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00850567 s, 58.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:08,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.227139 s, 4.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:10,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:10,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.144856 s, 7.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:12,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:13,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.342255 s, 3.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:15,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:15,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103086 s, 9.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:17,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:18,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0955912 s, 10.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:13:18,062::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-26::DEBUG::2014-08-21 12:13:18,065::task::595::TaskManager.Task::(_updateState) Task=`a300514e-ba65-4521-9811-8aff4fe6262f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:18,066::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:13:18,069::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:18,070::task::1185::TaskManager.Task::(prepare) Task=`a300514e-ba65-4521-9811-8aff4fe6262f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:18,072::task::595::TaskManager.Task::(_updateState) Task=`a300514e-ba65-4521-9811-8aff4fe6262f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:18,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:18,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:18,075::task::990::TaskManager.Task::(_decref) Task=`a300514e-ba65-4521-9811-8aff4fe6262f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:13:18,087::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23beca7]
>Thread-34::DEBUG::2014-08-21 12:13:18,088::task::595::TaskManager.Task::(_updateState) Task=`1b8ec920-a11f-4b9f-8a48-c9a35fb5db32`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:13:18,088::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:13:18,089::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8ed5a7d8-28be-4d76-be00-b210e7ba3133`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:13:18,089::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:13:18,089::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:13:18,089::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8ed5a7d8-28be-4d76-be00-b210e7ba3133`::Granted request
>Thread-34::DEBUG::2014-08-21 12:13:18,090::task::827::TaskManager.Task::(resourceAcquired) Task=`1b8ec920-a11f-4b9f-8a48-c9a35fb5db32`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:13:18,090::task::990::TaskManager.Task::(_decref) Task=`1b8ec920-a11f-4b9f-8a48-c9a35fb5db32`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:13:18,096::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:18,096::task::1185::TaskManager.Task::(prepare) Task=`1b8ec920-a11f-4b9f-8a48-c9a35fb5db32`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:18,097::task::595::TaskManager.Task::(_updateState) Task=`1b8ec920-a11f-4b9f-8a48-c9a35fb5db32`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:13:18,097::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:13:18,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:13:18,097::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:13:18,098::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:13:18,098::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:13:18,098::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:13:18,099::task::990::TaskManager.Task::(_decref) Task=`1b8ec920-a11f-4b9f-8a48-c9a35fb5db32`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:13:18,149::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:13:18,167::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000415975 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:20,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:13:20,967::task::595::TaskManager.Task::(_updateState) Task=`707a0d36-1643-48f3-9163-c72b64cfcd20`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:20,968::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:13:20,985::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415975', 'lastCheck': '2.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:13:20,986::task::1185::TaskManager.Task::(prepare) Task=`707a0d36-1643-48f3-9163-c72b64cfcd20`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415975', 'lastCheck': '2.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:13:20,986::task::595::TaskManager.Task::(_updateState) Task=`707a0d36-1643-48f3-9163-c72b64cfcd20`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:20,987::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:20,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:20,988::task::990::TaskManager.Task::(_decref) Task=`707a0d36-1643-48f3-9163-c72b64cfcd20`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:13:22,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.68711 s, 607 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:24,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:24,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111941 s, 9.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:26,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:26,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0864243 s, 11.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:13:28,110::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [464d05c]
>Thread-26::DEBUG::2014-08-21 12:13:28,111::task::595::TaskManager.Task::(_updateState) Task=`58d95ac8-4359-43c1-9005-2eb8defcfab0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:28,111::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:13:28,112::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:28,112::task::1185::TaskManager.Task::(prepare) Task=`58d95ac8-4359-43c1-9005-2eb8defcfab0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:28,112::task::595::TaskManager.Task::(_updateState) Task=`58d95ac8-4359-43c1-9005-2eb8defcfab0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:28,113::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:28,113::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:28,113::task::990::TaskManager.Task::(_decref) Task=`58d95ac8-4359-43c1-9005-2eb8defcfab0`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:13:28,121::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [464d05c]
>Thread-34::DEBUG::2014-08-21 12:13:28,122::task::595::TaskManager.Task::(_updateState) Task=`1864d8e1-967d-4dab-bd4e-45bc9d7f56cb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:13:28,122::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:13:28,123::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f6b5afce-3d9e-45ca-86a9-a6622555f62f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:13:28,123::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:13:28,124::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:13:28,124::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f6b5afce-3d9e-45ca-86a9-a6622555f62f`::Granted request
>Thread-34::DEBUG::2014-08-21 12:13:28,124::task::827::TaskManager.Task::(resourceAcquired) Task=`1864d8e1-967d-4dab-bd4e-45bc9d7f56cb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:13:28,125::task::990::TaskManager.Task::(_decref) Task=`1864d8e1-967d-4dab-bd4e-45bc9d7f56cb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:13:28,129::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:28,129::task::1185::TaskManager.Task::(prepare) Task=`1864d8e1-967d-4dab-bd4e-45bc9d7f56cb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:28,129::task::595::TaskManager.Task::(_updateState) Task=`1864d8e1-967d-4dab-bd4e-45bc9d7f56cb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:13:28,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:13:28,130::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:13:28,130::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:13:28,130::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:13:28,131::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:13:28,131::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:13:28,131::task::990::TaskManager.Task::(_decref) Task=`1864d8e1-967d-4dab-bd4e-45bc9d7f56cb`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:13:28,211::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:13:28,227::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0010143 s, 491 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:28,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:29,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.115343 s, 8.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:31,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:32,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.710051 s, 1.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:34,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:34,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110157 s, 9.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:36,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:36,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112121 s, 9.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:13:37,020::task::595::TaskManager.Task::(_updateState) Task=`c546180e-7e46-4cca-acba-c59a645172ea`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:37,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:13:37,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010143', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:13:37,022::task::1185::TaskManager.Task::(prepare) Task=`c546180e-7e46-4cca-acba-c59a645172ea`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010143', 'lastCheck': '8.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:13:37,023::task::595::TaskManager.Task::(_updateState) Task=`c546180e-7e46-4cca-acba-c59a645172ea`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:37,023::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:37,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:37,034::task::990::TaskManager.Task::(_decref) Task=`c546180e-7e46-4cca-acba-c59a645172ea`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:13:38,152::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-26::DEBUG::2014-08-21 12:13:38,153::task::595::TaskManager.Task::(_updateState) Task=`06c15938-64c2-4eef-ae91-dab169f7e4f4`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:38,153::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:13:38,154::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:38,154::task::1185::TaskManager.Task::(prepare) Task=`06c15938-64c2-4eef-ae91-dab169f7e4f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:38,155::task::595::TaskManager.Task::(_updateState) Task=`06c15938-64c2-4eef-ae91-dab169f7e4f4`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:38,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:38,155::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:38,155::task::990::TaskManager.Task::(_decref) Task=`06c15938-64c2-4eef-ae91-dab169f7e4f4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:13:38,170::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 12:13:38,171::task::595::TaskManager.Task::(_updateState) Task=`2a4ef9a2-c18d-4edf-a9ef-91165f35ccf4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:13:38,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:13:38,177::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1cb31f64-a522-485a-8f29-31b99bfda4c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:13:38,177::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:13:38,178::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:13:38,178::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1cb31f64-a522-485a-8f29-31b99bfda4c8`::Granted request
>Thread-34::DEBUG::2014-08-21 12:13:38,179::task::827::TaskManager.Task::(resourceAcquired) Task=`2a4ef9a2-c18d-4edf-a9ef-91165f35ccf4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:13:38,180::task::990::TaskManager.Task::(_decref) Task=`2a4ef9a2-c18d-4edf-a9ef-91165f35ccf4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:13:38,214::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968153600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:38,214::task::1185::TaskManager.Task::(prepare) Task=`2a4ef9a2-c18d-4edf-a9ef-91165f35ccf4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968153600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:38,215::task::595::TaskManager.Task::(_updateState) Task=`2a4ef9a2-c18d-4edf-a9ef-91165f35ccf4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:13:38,216::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:13:38,216::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:13:38,217::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:13:38,217::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:13:38,217::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:13:38,218::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:13:38,218::task::990::TaskManager.Task::(_decref) Task=`2a4ef9a2-c18d-4edf-a9ef-91165f35ccf4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:13:38,317::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:13:38,381::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0046322 s, 108 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:38,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:39,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.11862 s, 8.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:41,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:41,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0919904 s, 11.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:43,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:43,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.154252 s, 6.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:45,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:45,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0614405 s, 16.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:47,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:47,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0577777 s, 17.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:13:48,236::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-26::DEBUG::2014-08-21 12:13:48,238::task::595::TaskManager.Task::(_updateState) Task=`9b6d38c3-a2c9-4650-a9a4-3efa841b3079`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:48,238::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:13:48,239::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:48,239::task::1185::TaskManager.Task::(prepare) Task=`9b6d38c3-a2c9-4650-a9a4-3efa841b3079`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:48,239::task::595::TaskManager.Task::(_updateState) Task=`9b6d38c3-a2c9-4650-a9a4-3efa841b3079`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:48,239::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:48,239::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:48,239::task::990::TaskManager.Task::(_decref) Task=`9b6d38c3-a2c9-4650-a9a4-3efa841b3079`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:13:48,243::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d5f2617]
>Thread-34::DEBUG::2014-08-21 12:13:48,244::task::595::TaskManager.Task::(_updateState) Task=`dc90264f-9f43-428c-868f-298782bd9bcb`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:13:48,244::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:13:48,245::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`584145f3-f01e-46f3-bce4-71f7581f1f71`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:13:48,245::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:13:48,245::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:13:48,245::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`584145f3-f01e-46f3-bce4-71f7581f1f71`::Granted request
>Thread-34::DEBUG::2014-08-21 12:13:48,246::task::827::TaskManager.Task::(resourceAcquired) Task=`dc90264f-9f43-428c-868f-298782bd9bcb`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:13:48,246::task::990::TaskManager.Task::(_decref) Task=`dc90264f-9f43-428c-868f-298782bd9bcb`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:13:48,249::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:48,250::task::1185::TaskManager.Task::(prepare) Task=`dc90264f-9f43-428c-868f-298782bd9bcb`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:48,250::task::595::TaskManager.Task::(_updateState) Task=`dc90264f-9f43-428c-868f-298782bd9bcb`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:13:48,250::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:13:48,250::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:13:48,251::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:13:48,251::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:13:48,251::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:13:48,251::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:13:48,252::task::990::TaskManager.Task::(_decref) Task=`dc90264f-9f43-428c-868f-298782bd9bcb`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:13:48,427::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:13:48,446::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00228889 s, 218 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:49,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:50,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0558007 s, 18.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:52,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:52,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101805 s, 10.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:13:52,925::task::595::TaskManager.Task::(_updateState) Task=`5e52b5db-48b1-4de4-a280-7fbdb893e1d0`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:52,925::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:13:52,926::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00228889', 'lastCheck': '4.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:13:52,926::task::1185::TaskManager.Task::(prepare) Task=`5e52b5db-48b1-4de4-a280-7fbdb893e1d0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00228889', 'lastCheck': '4.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:13:52,926::task::595::TaskManager.Task::(_updateState) Task=`5e52b5db-48b1-4de4-a280-7fbdb893e1d0`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:52,926::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:52,926::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:52,927::task::990::TaskManager.Task::(_decref) Task=`5e52b5db-48b1-4de4-a280-7fbdb893e1d0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:13:54,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:13:55,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.824907 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:13:57,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:13:58,290::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-26::DEBUG::2014-08-21 12:13:58,295::task::595::TaskManager.Task::(_updateState) Task=`5cc9da75-2ad5-40b0-9dde-dd778f777c42`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:13:58,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:13:58,300::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:58,301::task::1185::TaskManager.Task::(prepare) Task=`5cc9da75-2ad5-40b0-9dde-dd778f777c42`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:13:58,302::task::595::TaskManager.Task::(_updateState) Task=`5cc9da75-2ad5-40b0-9dde-dd778f777c42`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:13:58,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:13:58,305::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:13:58,306::task::990::TaskManager.Task::(_decref) Task=`5cc9da75-2ad5-40b0-9dde-dd778f777c42`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:13:58,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 12:13:58,324::task::595::TaskManager.Task::(_updateState) Task=`d84ac360-67af-4ffe-a898-fad879bb9aed`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:13:58,326::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:13:58,331::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`76a0feee-82c3-4d64-a4d9-dde687896f83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:13:58,333::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:13:58,335::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:13:58,337::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`76a0feee-82c3-4d64-a4d9-dde687896f83`::Granted request
>Thread-34::DEBUG::2014-08-21 12:13:58,341::task::827::TaskManager.Task::(resourceAcquired) Task=`d84ac360-67af-4ffe-a898-fad879bb9aed`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:13:58,342::task::990::TaskManager.Task::(_decref) Task=`d84ac360-67af-4ffe-a898-fad879bb9aed`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:13:58,379::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968153600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:58,381::task::1185::TaskManager.Task::(prepare) Task=`d84ac360-67af-4ffe-a898-fad879bb9aed`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968153600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:13:58,383::task::595::TaskManager.Task::(_updateState) Task=`d84ac360-67af-4ffe-a898-fad879bb9aed`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:13:58,384::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:13:58,386::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:13:58,388::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:13:58,390::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:13:58,391::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:13:58,393::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:13:58,395::task::990::TaskManager.Task::(_decref) Task=`d84ac360-67af-4ffe-a898-fad879bb9aed`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:13:58,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.612895 s, 1.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:13:58,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:13:58,549::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00113663 s, 438 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:00,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:14:00,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0940914 s, 10.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:02,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:14:02,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102039 s, 10.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:05,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:14:06,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.384213 s, 2.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:14:08,425::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 12:14:08,427::task::595::TaskManager.Task::(_updateState) Task=`c266ffcd-f8da-4153-bdc4-cd4f9a865a2d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:14:08,427::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:14:08,428::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:14:08,428::task::1185::TaskManager.Task::(prepare) Task=`c266ffcd-f8da-4153-bdc4-cd4f9a865a2d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:14:08,429::task::595::TaskManager.Task::(_updateState) Task=`c266ffcd-f8da-4153-bdc4-cd4f9a865a2d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:14:08,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:14:08,429::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:14:08,430::task::990::TaskManager.Task::(_decref) Task=`c266ffcd-f8da-4153-bdc4-cd4f9a865a2d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:14:08,434::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-34::DEBUG::2014-08-21 12:14:08,434::task::595::TaskManager.Task::(_updateState) Task=`349a15e8-d3c8-463d-90b0-e6aad243cb53`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:14:08,435::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:14:08,436::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5eab0eb9-7a1e-4c63-b814-96e1aacc46d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:14:08,436::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:14:08,436::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:14:08,437::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5eab0eb9-7a1e-4c63-b814-96e1aacc46d0`::Granted request
>Thread-34::DEBUG::2014-08-21 12:14:08,438::task::827::TaskManager.Task::(resourceAcquired) Task=`349a15e8-d3c8-463d-90b0-e6aad243cb53`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:14:08,438::task::990::TaskManager.Task::(_decref) Task=`349a15e8-d3c8-463d-90b0-e6aad243cb53`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:14:08,444::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:14:08,444::task::1185::TaskManager.Task::(prepare) Task=`349a15e8-d3c8-463d-90b0-e6aad243cb53`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:14:08,444::task::595::TaskManager.Task::(_updateState) Task=`349a15e8-d3c8-463d-90b0-e6aad243cb53`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:14:08,445::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:14:08,445::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:14:08,445::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:14:08,446::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:14:08,446::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:14:08,446::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:14:08,447::task::990::TaskManager.Task::(_decref) Task=`349a15e8-d3c8-463d-90b0-e6aad243cb53`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:14:08,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:14:09,118::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:14:09,160::task::595::TaskManager.Task::(_updateState) Task=`e1408f89-7e4a-4cbc-9d47-f89692710c3e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:14:09,161::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:14:09,161::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113663', 'lastCheck': '10.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:14:09,162::task::1185::TaskManager.Task::(prepare) Task=`e1408f89-7e4a-4cbc-9d47-f89692710c3e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113663', 'lastCheck': '10.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:14:09,162::task::595::TaskManager.Task::(_updateState) Task=`e1408f89-7e4a-4cbc-9d47-f89692710c3e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:14:09,162::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:14:09,163::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:14:09,163::task::990::TaskManager.Task::(_decref) Task=`e1408f89-7e4a-4cbc-9d47-f89692710c3e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:14:09,226::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00809157 s, 61.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:09,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.670168 s, 1.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:14:21,670::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-13::DEBUG::2014-08-21 12:14:21,671::task::595::TaskManager.Task::(_updateState) Task=`6fef23cd-2256-4535-bafd-e9cfd8f189aa`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:14:21,671::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:14:21,672::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:14:21,672::task::1185::TaskManager.Task::(prepare) Task=`6fef23cd-2256-4535-bafd-e9cfd8f189aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:14:21,673::task::595::TaskManager.Task::(_updateState) Task=`6fef23cd-2256-4535-bafd-e9cfd8f189aa`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:14:21,673::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:14:21,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:14:21,673::task::990::TaskManager.Task::(_decref) Task=`6fef23cd-2256-4535-bafd-e9cfd8f189aa`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:14:21,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:14:23,441::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4dc3c823]
>Thread-34::DEBUG::2014-08-21 12:14:23,472::task::595::TaskManager.Task::(_updateState) Task=`ce556534-f0c3-4615-bee0-843bd43c1450`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:14:23,480::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:14:23,503::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8c064491-510c-4a46-ae0b-71a94726e3e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:14:23,515::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:14:23,608::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:14:23,616::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8c064491-510c-4a46-ae0b-71a94726e3e0`::Granted request
>Thread-34::DEBUG::2014-08-21 12:14:23,630::task::827::TaskManager.Task::(resourceAcquired) Task=`ce556534-f0c3-4615-bee0-843bd43c1450`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-15::DEBUG::2014-08-21 12:14:23,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:14:23,638::task::990::TaskManager.Task::(_decref) Task=`ce556534-f0c3-4615-bee0-843bd43c1450`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:14:23,725::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:14:23,728::task::1185::TaskManager.Task::(prepare) Task=`ce556534-f0c3-4615-bee0-843bd43c1450`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:14:23,732::task::595::TaskManager.Task::(_updateState) Task=`ce556534-f0c3-4615-bee0-843bd43c1450`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:14:23,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:14:23,740::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:14:23,747::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-15::DEBUG::2014-08-21 12:14:23,744::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000633591 s, 786 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:14:23,752::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:14:23,758::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:14:23,763::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:14:23,769::task::990::TaskManager.Task::(_decref) Task=`ce556534-f0c3-4615-bee0-843bd43c1450`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:14:23,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.79482 s, 571 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:25,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:14:26,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0543561 s, 18.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:28,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:14:28,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0578284 s, 17.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:30,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:14:30,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0923384 s, 11.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:32,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:14:34,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.09076 s, 939 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:14:34,760::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-26::DEBUG::2014-08-21 12:14:34,785::task::595::TaskManager.Task::(_updateState) Task=`33505774-cfe2-420a-8da5-af07fd7f5441`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:14:34,786::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:14:34,786::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:14:34,787::task::1185::TaskManager.Task::(prepare) Task=`33505774-cfe2-420a-8da5-af07fd7f5441`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:14:34,787::task::595::TaskManager.Task::(_updateState) Task=`33505774-cfe2-420a-8da5-af07fd7f5441`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 12:14:34,837::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:14:34,836::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:14:35,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:14:35,289::task::990::TaskManager.Task::(_decref) Task=`33505774-cfe2-420a-8da5-af07fd7f5441`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:14:35,338::task::595::TaskManager.Task::(_updateState) Task=`622f3d80-6bbb-4975-80cf-23dc1c0c5db7`::moving from state init -> state preparing
>Thread-15::DEBUG::2014-08-21 12:14:35,880::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00171996 s, 290 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:14:36,327::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 12:14:36,329::task::595::TaskManager.Task::(_updateState) Task=`d16d552a-0c17-4d72-97a8-39a3c1e22111`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:14:36,329::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:14:36,346::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b811d571-5016-4abf-bea7-d0d07bdf79e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:14:36,347::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:14:36,348::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-13::INFO::2014-08-21 12:14:36,359::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-34::DEBUG::2014-08-21 12:14:36,400::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b811d571-5016-4abf-bea7-d0d07bdf79e3`::Granted request
>Thread-34::DEBUG::2014-08-21 12:14:36,402::task::827::TaskManager.Task::(resourceAcquired) Task=`d16d552a-0c17-4d72-97a8-39a3c1e22111`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:14:36,402::task::990::TaskManager.Task::(_decref) Task=`d16d552a-0c17-4d72-97a8-39a3c1e22111`::ref 1 aborting False
>Dummy-33::DEBUG::2014-08-21 12:14:36,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::INFO::2014-08-21 12:14:39,450::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171996', 'lastCheck': '2.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:14:39,541::task::1185::TaskManager.Task::(prepare) Task=`622f3d80-6bbb-4975-80cf-23dc1c0c5db7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171996', 'lastCheck': '2.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:14:39,719::task::595::TaskManager.Task::(_updateState) Task=`622f3d80-6bbb-4975-80cf-23dc1c0c5db7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:14:40,098::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-34::INFO::2014-08-21 12:14:40,129::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:14:40,130::task::1185::TaskManager.Task::(prepare) Task=`d16d552a-0c17-4d72-97a8-39a3c1e22111`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:14:40,131::task::595::TaskManager.Task::(_updateState) Task=`d16d552a-0c17-4d72-97a8-39a3c1e22111`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:14:40,131::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-13::DEBUG::2014-08-21 12:14:40,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:14:40,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:14:42,028::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:14:42,029::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:14:42,029::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:14:42,030::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:14:42,030::task::990::TaskManager.Task::(_decref) Task=`d16d552a-0c17-4d72-97a8-39a3c1e22111`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:14:42,161::task::990::TaskManager.Task::(_decref) Task=`622f3d80-6bbb-4975-80cf-23dc1c0c5db7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:14:46,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.94367 s, 129 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:14:46,614::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:14:46,706::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000568907 s, 875 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:48,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:14:54,979::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-26::DEBUG::2014-08-21 12:14:54,986::task::595::TaskManager.Task::(_updateState) Task=`5e6a0c1e-a86e-4648-8d41-18cc7b13fc86`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:14:55,030::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:14:55,073::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:14:55,098::task::1185::TaskManager.Task::(prepare) Task=`5e6a0c1e-a86e-4648-8d41-18cc7b13fc86`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:14:55,106::task::595::TaskManager.Task::(_updateState) Task=`5e6a0c1e-a86e-4648-8d41-18cc7b13fc86`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:14:55,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:14:55,120::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:14:55,127::task::990::TaskManager.Task::(_decref) Task=`5e6a0c1e-a86e-4648-8d41-18cc7b13fc86`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:14:55,147::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7bdd4b0]
>Thread-34::DEBUG::2014-08-21 12:14:55,151::task::595::TaskManager.Task::(_updateState) Task=`bc690b90-4bfa-491d-a639-86c4717391c9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:14:55,153::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:14:55,160::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d459545a-320a-4787-8811-6bbe660a87ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:14:55,163::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:14:55,169::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:14:55,172::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d459545a-320a-4787-8811-6bbe660a87ac`::Granted request
>Thread-34::DEBUG::2014-08-21 12:14:55,178::task::827::TaskManager.Task::(resourceAcquired) Task=`bc690b90-4bfa-491d-a639-86c4717391c9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:14:55,181::task::990::TaskManager.Task::(_decref) Task=`bc690b90-4bfa-491d-a639-86c4717391c9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:14:55,388::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967367168', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:14:55,391::task::1185::TaskManager.Task::(prepare) Task=`bc690b90-4bfa-491d-a639-86c4717391c9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967367168', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:14:55,393::task::595::TaskManager.Task::(_updateState) Task=`bc690b90-4bfa-491d-a639-86c4717391c9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:14:55,395::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:14:55,398::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:14:55,402::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:14:55,408::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:14:55,410::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:14:55,412::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:14:55,415::task::990::TaskManager.Task::(_decref) Task=`bc690b90-4bfa-491d-a639-86c4717391c9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:14:55,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.83797 s, 175 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:14:56,747::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:14:56,766::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000854364 s, 583 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:57,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:14:57,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.262038 s, 3.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:14:59,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:15:00,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0986583 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:15:02,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:15:02,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.160733 s, 6.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:15:04,196::task::595::TaskManager.Task::(_updateState) Task=`269f5d58-7bcb-4415-8699-efb025f3459d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:15:04,196::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:15:04,197::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000854364', 'lastCheck': '7.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:15:04,197::task::1185::TaskManager.Task::(prepare) Task=`269f5d58-7bcb-4415-8699-efb025f3459d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000854364', 'lastCheck': '7.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:15:04,197::task::595::TaskManager.Task::(_updateState) Task=`269f5d58-7bcb-4415-8699-efb025f3459d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:15:04,197::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:15:04,198::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:15:04,198::task::990::TaskManager.Task::(_decref) Task=`269f5d58-7bcb-4415-8699-efb025f3459d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:15:04,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:15:04,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0693296 s, 14.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:15:05,448::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-26::DEBUG::2014-08-21 12:15:05,450::task::595::TaskManager.Task::(_updateState) Task=`a9adc202-b5cf-4e5b-bb50-6f1145ee04b5`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:15:05,451::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:15:05,452::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:15:05,452::task::1185::TaskManager.Task::(prepare) Task=`a9adc202-b5cf-4e5b-bb50-6f1145ee04b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:15:05,452::task::595::TaskManager.Task::(_updateState) Task=`a9adc202-b5cf-4e5b-bb50-6f1145ee04b5`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:15:05,452::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:15:05,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:15:05,453::task::990::TaskManager.Task::(_decref) Task=`a9adc202-b5cf-4e5b-bb50-6f1145ee04b5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:15:05,459::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2264205d]
>Thread-34::DEBUG::2014-08-21 12:15:05,460::task::595::TaskManager.Task::(_updateState) Task=`d85a36fb-d5e3-447c-a8fd-0e904fd049cf`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:15:05,460::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:15:05,461::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bf2143bc-403b-468c-ae8d-dfa766917743`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:15:05,461::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:15:05,462::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:15:05,462::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`bf2143bc-403b-468c-ae8d-dfa766917743`::Granted request
>Thread-34::DEBUG::2014-08-21 12:15:05,462::task::827::TaskManager.Task::(resourceAcquired) Task=`d85a36fb-d5e3-447c-a8fd-0e904fd049cf`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:15:05,463::task::990::TaskManager.Task::(_decref) Task=`d85a36fb-d5e3-447c-a8fd-0e904fd049cf`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:15:05,468::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:15:05,469::task::1185::TaskManager.Task::(prepare) Task=`d85a36fb-d5e3-447c-a8fd-0e904fd049cf`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:15:05,469::task::595::TaskManager.Task::(_updateState) Task=`d85a36fb-d5e3-447c-a8fd-0e904fd049cf`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:15:05,470::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:15:05,470::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:15:05,470::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:15:05,471::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:15:05,471::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:15:05,471::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:15:05,472::task::990::TaskManager.Task::(_decref) Task=`d85a36fb-d5e3-447c-a8fd-0e904fd049cf`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:15:06,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:15:06,887::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:15:07,036::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.110964 s, 4.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:15:07,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.21963 s, 4.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:15:09,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:15:12,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.836292 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:15:14,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:15:26,400::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-13::DEBUG::2014-08-21 12:15:26,411::task::595::TaskManager.Task::(_updateState) Task=`b1682419-7243-4ae9-8ef4-741dc9779d01`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:15:26,415::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:15:26,422::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:15:26,460::task::1185::TaskManager.Task::(prepare) Task=`b1682419-7243-4ae9-8ef4-741dc9779d01`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:15:26,479::task::595::TaskManager.Task::(_updateState) Task=`b1682419-7243-4ae9-8ef4-741dc9779d01`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:15:26,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:15:26,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:15:26,562::task::990::TaskManager.Task::(_decref) Task=`b1682419-7243-4ae9-8ef4-741dc9779d01`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:15:26,610::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-34::DEBUG::2014-08-21 12:15:26,619::task::595::TaskManager.Task::(_updateState) Task=`7f0c0406-bbf9-4473-8cc0-ec20c71bce21`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:15:26,626::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:15:26,639::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f5ba7cd3-0872-4018-9ebe-727d4315ed76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:15:26,645::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:15:26,656::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:15:26,664::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f5ba7cd3-0872-4018-9ebe-727d4315ed76`::Granted request
>Thread-34::DEBUG::2014-08-21 12:15:26,675::task::827::TaskManager.Task::(resourceAcquired) Task=`7f0c0406-bbf9-4473-8cc0-ec20c71bce21`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:15:26,681::task::990::TaskManager.Task::(_decref) Task=`7f0c0406-bbf9-4473-8cc0-ec20c71bce21`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:15:26,696::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:15:35,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00146684 s, 340 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 12:15:35,288::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967367168', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:15:35,291::task::1185::TaskManager.Task::(prepare) Task=`7f0c0406-bbf9-4473-8cc0-ec20c71bce21`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967367168', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:15:35,297::task::595::TaskManager.Task::(_updateState) Task=`7f0c0406-bbf9-4473-8cc0-ec20c71bce21`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:15:35,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:15:35,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:15:35,319::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:15:35,325::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:15:35,329::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:15:35,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:15:35,337::task::990::TaskManager.Task::(_decref) Task=`7f0c0406-bbf9-4473-8cc0-ec20c71bce21`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:15:35,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 9.39595 s, 109 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:15:37,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:15:37,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.133474 s, 7.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:15:38,261::task::595::TaskManager.Task::(_updateState) Task=`78b3986e-f0cf-49da-8f3e-6c7845b860ea`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:15:38,262::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:15:38,262::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146684', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:15:38,262::task::1185::TaskManager.Task::(prepare) Task=`78b3986e-f0cf-49da-8f3e-6c7845b860ea`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146684', 'lastCheck': '2.9', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:15:38,263::task::595::TaskManager.Task::(_updateState) Task=`78b3986e-f0cf-49da-8f3e-6c7845b860ea`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:15:38,263::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:15:38,263::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:15:38,264::task::990::TaskManager.Task::(_decref) Task=`78b3986e-f0cf-49da-8f3e-6c7845b860ea`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:15:39,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:15:40,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.03621 s, 988 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:15:43,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:15:43,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.325006 s, 3.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:15:45,987::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Dummy-33::DEBUG::2014-08-21 12:15:46,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:15:46,099::task::595::TaskManager.Task::(_updateState) Task=`dbea2a03-831b-4304-a5cd-77139d6aa36d`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:15:46,377::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:15:46,410::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:15:46,411::task::1185::TaskManager.Task::(prepare) Task=`dbea2a03-831b-4304-a5cd-77139d6aa36d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:15:46,412::task::595::TaskManager.Task::(_updateState) Task=`dbea2a03-831b-4304-a5cd-77139d6aa36d`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:15:46,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:15:46,425::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:15:46,425::task::990::TaskManager.Task::(_decref) Task=`dbea2a03-831b-4304-a5cd-77139d6aa36d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:15:46,790::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [141a349c]
>Thread-34::DEBUG::2014-08-21 12:15:46,791::task::595::TaskManager.Task::(_updateState) Task=`fb18f5e3-6a45-4c2b-b902-ef90029a7d52`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:15:46,792::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 12:15:46,946::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:15:47,006::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5fa36edb-d898-4f69-b5e5-1c2a91b21064`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:15:47,007::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 12:15:47,384::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0630327 s, 7.9 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:15:47,408::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:15:47,409::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5fa36edb-d898-4f69-b5e5-1c2a91b21064`::Granted request
>Thread-34::DEBUG::2014-08-21 12:15:47,410::task::827::TaskManager.Task::(resourceAcquired) Task=`fb18f5e3-6a45-4c2b-b902-ef90029a7d52`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:15:47,411::task::990::TaskManager.Task::(_decref) Task=`fb18f5e3-6a45-4c2b-b902-ef90029a7d52`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:15:47,503::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:15:47,504::task::1185::TaskManager.Task::(prepare) Task=`fb18f5e3-6a45-4c2b-b902-ef90029a7d52`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:15:47,505::task::595::TaskManager.Task::(_updateState) Task=`fb18f5e3-6a45-4c2b-b902-ef90029a7d52`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:15:47,543::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:15:47,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:15:47,556::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:15:47,557::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:15:47,558::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:15:47,558::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:15:47,559::task::990::TaskManager.Task::(_decref) Task=`fb18f5e3-6a45-4c2b-b902-ef90029a7d52`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:15:51,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 5.41112 s, 189 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:15:56,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:15:56,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0846703 s, 12.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:15:58,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:15:59,573::task::595::TaskManager.Task::(_updateState) Task=`1d160ac0-abd2-4124-9abf-2b19ef92aece`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:15:59,574::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:15:59,575::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0630327', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:15:59,575::task::1185::TaskManager.Task::(prepare) Task=`1d160ac0-abd2-4124-9abf-2b19ef92aece`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0630327', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:15:59,576::task::595::TaskManager.Task::(_updateState) Task=`1d160ac0-abd2-4124-9abf-2b19ef92aece`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:15:59,576::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:15:59,576::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:15:59,577::task::990::TaskManager.Task::(_decref) Task=`1d160ac0-abd2-4124-9abf-2b19ef92aece`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:15:59,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.837026 s, 1.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:16:00,266::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14a1da75]
>Thread-13::DEBUG::2014-08-21 12:16:00,267::task::595::TaskManager.Task::(_updateState) Task=`6c0075c2-a69d-4ffb-afe3-e2ff2be425e4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:16:00,268::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:16:00,268::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:00,269::task::1185::TaskManager.Task::(prepare) Task=`6c0075c2-a69d-4ffb-afe3-e2ff2be425e4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:00,269::task::595::TaskManager.Task::(_updateState) Task=`6c0075c2-a69d-4ffb-afe3-e2ff2be425e4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:16:00,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:16:00,269::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:16:00,270::task::990::TaskManager.Task::(_decref) Task=`6c0075c2-a69d-4ffb-afe3-e2ff2be425e4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:16:00,274::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14a1da75]
>Thread-34::DEBUG::2014-08-21 12:16:00,275::task::595::TaskManager.Task::(_updateState) Task=`e0f00629-cb8f-407a-be64-8bb23a2e556b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:16:00,275::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:16:00,275::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0cb9e49a-3e01-474b-9f98-b5f9a26e8856`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:16:00,276::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:16:00,276::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:16:00,276::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0cb9e49a-3e01-474b-9f98-b5f9a26e8856`::Granted request
>Thread-34::DEBUG::2014-08-21 12:16:00,277::task::827::TaskManager.Task::(resourceAcquired) Task=`e0f00629-cb8f-407a-be64-8bb23a2e556b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:16:00,277::task::990::TaskManager.Task::(_decref) Task=`e0f00629-cb8f-407a-be64-8bb23a2e556b`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:16:00,281::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:00,281::task::1185::TaskManager.Task::(prepare) Task=`e0f00629-cb8f-407a-be64-8bb23a2e556b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:00,281::task::595::TaskManager.Task::(_updateState) Task=`e0f00629-cb8f-407a-be64-8bb23a2e556b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:16:00,282::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:16:00,282::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:16:00,282::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:16:00,282::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:16:00,283::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:16:00,283::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:16:00,283::task::990::TaskManager.Task::(_decref) Task=`e0f00629-cb8f-407a-be64-8bb23a2e556b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:16:00,548::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:16:00,566::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000533423 s, 934 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:01,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:02,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.228525 s, 4.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:04,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:04,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.147132 s, 7.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:06,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:07,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.381333 s, 2.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:09,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:09,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.133932 s, 7.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:16:10,303::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-13::DEBUG::2014-08-21 12:16:10,306::task::595::TaskManager.Task::(_updateState) Task=`12e8ae1b-5e6b-40b7-9dc4-82e43b18cff5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:16:10,307::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:16:10,310::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:10,311::task::1185::TaskManager.Task::(prepare) Task=`12e8ae1b-5e6b-40b7-9dc4-82e43b18cff5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:10,314::task::595::TaskManager.Task::(_updateState) Task=`12e8ae1b-5e6b-40b7-9dc4-82e43b18cff5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:16:10,316::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:16:10,327::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:16:10,376::task::990::TaskManager.Task::(_decref) Task=`12e8ae1b-5e6b-40b7-9dc4-82e43b18cff5`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:16:10,393::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-34::DEBUG::2014-08-21 12:16:10,394::task::595::TaskManager.Task::(_updateState) Task=`5e19b850-b49f-484e-b989-8662d34765ab`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:16:10,401::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:16:10,402::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d8f6971a-df6a-407f-9a86-c4c9102aa7a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:16:10,402::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:16:10,403::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:16:10,403::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d8f6971a-df6a-407f-9a86-c4c9102aa7a9`::Granted request
>Thread-34::DEBUG::2014-08-21 12:16:10,404::task::827::TaskManager.Task::(resourceAcquired) Task=`5e19b850-b49f-484e-b989-8662d34765ab`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:16:10,405::task::990::TaskManager.Task::(_decref) Task=`5e19b850-b49f-484e-b989-8662d34765ab`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:16:10,480::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:10,480::task::1185::TaskManager.Task::(prepare) Task=`5e19b850-b49f-484e-b989-8662d34765ab`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:10,481::task::595::TaskManager.Task::(_updateState) Task=`5e19b850-b49f-484e-b989-8662d34765ab`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:16:10,481::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:16:10,481::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:16:10,482::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:16:10,483::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:16:10,483::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:16:10,483::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:16:10,484::task::990::TaskManager.Task::(_decref) Task=`5e19b850-b49f-484e-b989-8662d34765ab`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:16:10,926::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:16:10,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000682406 s, 730 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:11,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:12,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.995113 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:15,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:16:15,272::task::595::TaskManager.Task::(_updateState) Task=`2161404d-271b-4108-8e7c-a24cab8016e2`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:16:15,273::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:16:15,273::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682406', 'lastCheck': '4.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:16:15,274::task::1185::TaskManager.Task::(prepare) Task=`2161404d-271b-4108-8e7c-a24cab8016e2`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682406', 'lastCheck': '4.3', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:16:15,274::task::595::TaskManager.Task::(_updateState) Task=`2161404d-271b-4108-8e7c-a24cab8016e2`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:16:15,277::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:16:15,277::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:16:15,277::task::990::TaskManager.Task::(_decref) Task=`2161404d-271b-4108-8e7c-a24cab8016e2`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:16:16,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.87671 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:18,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:18,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.229315 s, 4.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:16:20,546::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-13::DEBUG::2014-08-21 12:16:20,547::task::595::TaskManager.Task::(_updateState) Task=`a2b893b8-02c6-4b2b-a96a-df3a4d37c60b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:16:20,548::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:16:20,549::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:20,549::task::1185::TaskManager.Task::(prepare) Task=`a2b893b8-02c6-4b2b-a96a-df3a4d37c60b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:20,549::task::595::TaskManager.Task::(_updateState) Task=`a2b893b8-02c6-4b2b-a96a-df3a4d37c60b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:16:20,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:16:20,550::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:16:20,550::task::990::TaskManager.Task::(_decref) Task=`a2b893b8-02c6-4b2b-a96a-df3a4d37c60b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:16:20,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:16:20,679::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-34::DEBUG::2014-08-21 12:16:20,682::task::595::TaskManager.Task::(_updateState) Task=`ea1cbef2-b43e-4f4d-b96e-4447fdef157d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:16:20,682::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:16:20,684::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b8a31464-8ab7-4bc4-8ff6-8e3137a803b4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:16:20,686::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:16:20,687::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:16:20,688::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b8a31464-8ab7-4bc4-8ff6-8e3137a803b4`::Granted request
>Thread-34::DEBUG::2014-08-21 12:16:20,689::task::827::TaskManager.Task::(resourceAcquired) Task=`ea1cbef2-b43e-4f4d-b96e-4447fdef157d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:16:20,689::task::990::TaskManager.Task::(_decref) Task=`ea1cbef2-b43e-4f4d-b96e-4447fdef157d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:16:20,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968350208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:20,702::task::1185::TaskManager.Task::(prepare) Task=`ea1cbef2-b43e-4f4d-b96e-4447fdef157d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968350208', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:20,703::task::595::TaskManager.Task::(_updateState) Task=`ea1cbef2-b43e-4f4d-b96e-4447fdef157d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:16:20,703::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:16:20,703::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:16:20,704::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:16:20,705::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:16:20,705::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:16:20,705::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:16:20,705::task::990::TaskManager.Task::(_decref) Task=`ea1cbef2-b43e-4f4d-b96e-4447fdef157d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:16:20,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124928 s, 8.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:16:21,141::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:16:21,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000819948 s, 607 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:22,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:23,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.21883 s, 4.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:25,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:25,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119145 s, 8.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:27,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:27,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.118946 s, 8.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:30,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:30,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869805 s, 11.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:16:30,737::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-13::DEBUG::2014-08-21 12:16:30,740::task::595::TaskManager.Task::(_updateState) Task=`45f0c059-dbe2-410c-a042-eb10a9946014`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:16:30,741::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:16:30,742::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:30,742::task::1185::TaskManager.Task::(prepare) Task=`45f0c059-dbe2-410c-a042-eb10a9946014`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:30,743::task::595::TaskManager.Task::(_updateState) Task=`45f0c059-dbe2-410c-a042-eb10a9946014`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:16:30,744::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:16:30,744::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:16:30,745::task::990::TaskManager.Task::(_decref) Task=`45f0c059-dbe2-410c-a042-eb10a9946014`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:16:30,750::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 12:16:30,751::task::595::TaskManager.Task::(_updateState) Task=`f0fa91d8-3fa8-4092-8286-157f7d3a1f9f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:16:30,752::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:16:30,752::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8720b57b-6fc5-4bff-b321-90242de82efc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:16:30,753::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:16:30,753::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:16:30,753::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8720b57b-6fc5-4bff-b321-90242de82efc`::Granted request
>Thread-34::DEBUG::2014-08-21 12:16:30,755::task::827::TaskManager.Task::(resourceAcquired) Task=`f0fa91d8-3fa8-4092-8286-157f7d3a1f9f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:16:30,756::task::990::TaskManager.Task::(_decref) Task=`f0fa91d8-3fa8-4092-8286-157f7d3a1f9f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:16:30,762::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:30,762::task::1185::TaskManager.Task::(prepare) Task=`f0fa91d8-3fa8-4092-8286-157f7d3a1f9f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:30,763::task::595::TaskManager.Task::(_updateState) Task=`f0fa91d8-3fa8-4092-8286-157f7d3a1f9f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:16:30,763::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:16:30,763::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:16:30,764::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:16:30,764::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:16:30,765::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:16:30,765::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:16:30,765::task::990::TaskManager.Task::(_decref) Task=`f0fa91d8-3fa8-4092-8286-157f7d3a1f9f`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:16:30,967::task::595::TaskManager.Task::(_updateState) Task=`a77bab44-f303-43aa-849b-5c481a9bcd7c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:16:30,967::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:16:30,968::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819948', 'lastCheck': '9.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:16:30,968::task::1185::TaskManager.Task::(prepare) Task=`a77bab44-f303-43aa-849b-5c481a9bcd7c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819948', 'lastCheck': '9.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:16:30,968::task::595::TaskManager.Task::(_updateState) Task=`a77bab44-f303-43aa-849b-5c481a9bcd7c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:16:30,968::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:16:30,968::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:16:30,969::task::990::TaskManager.Task::(_decref) Task=`a77bab44-f303-43aa-849b-5c481a9bcd7c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:16:31,219::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:16:31,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000642791 s, 775 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:32,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:32,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0997251 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:34,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:34,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.177198 s, 5.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:39,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:16:42,949::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 12:16:42,950::task::595::TaskManager.Task::(_updateState) Task=`dee39124-7553-4495-aa20-0d8df52ee561`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:16:42,951::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:16:42,951::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:42,952::task::1185::TaskManager.Task::(prepare) Task=`dee39124-7553-4495-aa20-0d8df52ee561`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:42,952::task::595::TaskManager.Task::(_updateState) Task=`dee39124-7553-4495-aa20-0d8df52ee561`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:16:42,952::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:16:42,953::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:16:42,953::task::990::TaskManager.Task::(_decref) Task=`dee39124-7553-4495-aa20-0d8df52ee561`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:16:42,966::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-34::DEBUG::2014-08-21 12:16:42,966::task::595::TaskManager.Task::(_updateState) Task=`de3883c0-2496-4d5c-8eef-634fafca63db`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:16:42,967::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:16:42,968::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fe14236d-b9fb-432c-84b4-37142869dd65`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:16:42,968::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:16:42,968::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:16:42,969::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`fe14236d-b9fb-432c-84b4-37142869dd65`::Granted request
>Thread-34::DEBUG::2014-08-21 12:16:42,969::task::827::TaskManager.Task::(resourceAcquired) Task=`de3883c0-2496-4d5c-8eef-634fafca63db`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:16:42,970::task::990::TaskManager.Task::(_decref) Task=`de3883c0-2496-4d5c-8eef-634fafca63db`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:16:42,975::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:42,980::task::1185::TaskManager.Task::(prepare) Task=`de3883c0-2496-4d5c-8eef-634fafca63db`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:42,981::task::595::TaskManager.Task::(_updateState) Task=`de3883c0-2496-4d5c-8eef-634fafca63db`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:16:42,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:16:42,982::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:16:42,985::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:16:42,988::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-15::DEBUG::2014-08-21 12:16:42,991::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:16:42,992::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:16:43,007::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:16:43,013::task::990::TaskManager.Task::(_decref) Task=`de3883c0-2496-4d5c-8eef-634fafca63db`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:16:43,054::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000906159 s, 550 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:43,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.1208 s, 328 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:45,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:45,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0768864 s, 13.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:47,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:47,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0637552 s, 16.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:50,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:16:52,036::task::595::TaskManager.Task::(_updateState) Task=`e5f2a0f5-354e-4ac9-9595-9ae6a37e6c99`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:16:52,056::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:16:52,065::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000906159', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:16:52,065::task::1185::TaskManager.Task::(prepare) Task=`e5f2a0f5-354e-4ac9-9595-9ae6a37e6c99`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000906159', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:16:52,065::task::595::TaskManager.Task::(_updateState) Task=`e5f2a0f5-354e-4ac9-9595-9ae6a37e6c99`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:16:52,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:16:52,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:16:52,066::task::990::TaskManager.Task::(_decref) Task=`e5f2a0f5-354e-4ac9-9595-9ae6a37e6c99`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:16:52,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.715025 s, 1.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:16:53,063::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-13::DEBUG::2014-08-21 12:16:53,064::task::595::TaskManager.Task::(_updateState) Task=`3a916c20-d262-4206-9c97-d91ef2ffd033`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:16:53,065::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:16:53,066::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:53,066::task::1185::TaskManager.Task::(prepare) Task=`3a916c20-d262-4206-9c97-d91ef2ffd033`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:16:53,066::task::595::TaskManager.Task::(_updateState) Task=`3a916c20-d262-4206-9c97-d91ef2ffd033`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:16:53,072::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:16:53,072::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:16:53,072::task::990::TaskManager.Task::(_decref) Task=`3a916c20-d262-4206-9c97-d91ef2ffd033`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:16:53,137::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 12:16:53,441::task::595::TaskManager.Task::(_updateState) Task=`88048390-e373-480d-a278-bcff7da41141`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:16:53,475::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Dummy-33::DEBUG::2014-08-21 12:16:54,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:16:54,634::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3324aded-f03a-46c8-8847-1e2464aa5da7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:16:55,791::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:16:55,791::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:16:55,792::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3324aded-f03a-46c8-8847-1e2464aa5da7`::Granted request
>Thread-34::DEBUG::2014-08-21 12:16:55,852::task::827::TaskManager.Task::(resourceAcquired) Task=`88048390-e373-480d-a278-bcff7da41141`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:16:55,861::task::990::TaskManager.Task::(_decref) Task=`88048390-e373-480d-a278-bcff7da41141`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:16:56,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 12:16:57,024::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:57,025::task::1185::TaskManager.Task::(prepare) Task=`88048390-e373-480d-a278-bcff7da41141`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:16:57,026::task::595::TaskManager.Task::(_updateState) Task=`88048390-e373-480d-a278-bcff7da41141`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:16:57,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:16:57,060::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:16:57,072::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:16:57,081::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-15::DEBUG::2014-08-21 12:16:57,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00185982 s, 268 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:16:57,088::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:16:57,170::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:16:57,244::task::990::TaskManager.Task::(_decref) Task=`88048390-e373-480d-a278-bcff7da41141`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:16:57,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.72354 s, 376 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:16:59,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:16:59,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.288702 s, 3.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:01,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:01,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0713541 s, 14.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:03,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:04,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111422 s, 9.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:06,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:17:08,262::task::595::TaskManager.Task::(_updateState) Task=`0ed1bc09-cfc2-4b46-a971-48928c2ff10d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:17:08,412::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::DEBUG::2014-08-21 12:17:08,433::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-26::INFO::2014-08-21 12:17:08,438::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00185982', 'lastCheck': '11.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:17:08,452::task::595::TaskManager.Task::(_updateState) Task=`8aa4fb55-8a7c-4c35-8acc-87d7a644e6bc`::moving from state init -> state preparing
>Thread-26::DEBUG::2014-08-21 12:17:08,452::task::1185::TaskManager.Task::(prepare) Task=`0ed1bc09-cfc2-4b46-a971-48928c2ff10d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00185982', 'lastCheck': '11.1', 'valid': True}}
>Thread-13::INFO::2014-08-21 12:17:08,467::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::DEBUG::2014-08-21 12:17:08,476::task::595::TaskManager.Task::(_updateState) Task=`0ed1bc09-cfc2-4b46-a971-48928c2ff10d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:17:08,499::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:17:08,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:17:08,503::task::990::TaskManager.Task::(_decref) Task=`0ed1bc09-cfc2-4b46-a971-48928c2ff10d`::ref 0 aborting False
>Thread-13::INFO::2014-08-21 12:17:08,486::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:17:08,603::task::1185::TaskManager.Task::(prepare) Task=`8aa4fb55-8a7c-4c35-8acc-87d7a644e6bc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:17:08,624::task::595::TaskManager.Task::(_updateState) Task=`8aa4fb55-8a7c-4c35-8acc-87d7a644e6bc`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:17:08,636::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:17:08,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:17:08,661::task::990::TaskManager.Task::(_decref) Task=`8aa4fb55-8a7c-4c35-8acc-87d7a644e6bc`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:17:08,703::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:17:08,732::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-34::DEBUG::2014-08-21 12:17:08,744::task::595::TaskManager.Task::(_updateState) Task=`868602d1-e62a-4102-abd5-29660b05fc5c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:17:08,751::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:17:08,764::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d636f931-f219-41fa-8090-049117a262a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:17:08,766::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:17:08,771::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-15::DEBUG::2014-08-21 12:17:08,770::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00115961 s, 429 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:17:08,774::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d636f931-f219-41fa-8090-049117a262a0`::Granted request
>Thread-34::DEBUG::2014-08-21 12:17:08,787::task::827::TaskManager.Task::(resourceAcquired) Task=`868602d1-e62a-4102-abd5-29660b05fc5c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:17:08,791::task::990::TaskManager.Task::(_decref) Task=`868602d1-e62a-4102-abd5-29660b05fc5c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:17:08,827::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:08,829::task::1185::TaskManager.Task::(prepare) Task=`868602d1-e62a-4102-abd5-29660b05fc5c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:08,830::task::595::TaskManager.Task::(_updateState) Task=`868602d1-e62a-4102-abd5-29660b05fc5c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:17:08,831::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:17:08,832::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:17:08,834::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:17:08,835::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:17:08,836::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:17:08,836::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:17:08,838::task::990::TaskManager.Task::(_decref) Task=`868602d1-e62a-4102-abd5-29660b05fc5c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:17:08,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.44133 s, 419 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:10,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:11,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.216138 s, 4.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:13,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:13,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.271436 s, 3.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:15,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:15,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0491144 s, 20.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:17,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:18,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0653235 s, 15.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:17:18,836::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:17:18,859::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00151182 s, 329 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:17:18,863::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-26::DEBUG::2014-08-21 12:17:18,864::task::595::TaskManager.Task::(_updateState) Task=`62b8515c-5bf0-4ad0-8af3-b061ec00ec87`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:17:18,865::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:17:18,866::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:17:18,866::task::1185::TaskManager.Task::(prepare) Task=`62b8515c-5bf0-4ad0-8af3-b061ec00ec87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:17:18,866::task::595::TaskManager.Task::(_updateState) Task=`62b8515c-5bf0-4ad0-8af3-b061ec00ec87`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:17:18,866::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:17:18,867::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:17:18,870::task::990::TaskManager.Task::(_decref) Task=`62b8515c-5bf0-4ad0-8af3-b061ec00ec87`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:17:18,918::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-34::DEBUG::2014-08-21 12:17:18,919::task::595::TaskManager.Task::(_updateState) Task=`ff516a60-8676-4bc2-b519-59978c56e212`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:17:18,922::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:17:18,924::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ec4b374a-678f-4461-928f-bd1315cd5d5b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:17:18,925::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:17:18,926::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:17:18,926::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ec4b374a-678f-4461-928f-bd1315cd5d5b`::Granted request
>Thread-34::DEBUG::2014-08-21 12:17:18,927::task::827::TaskManager.Task::(resourceAcquired) Task=`ff516a60-8676-4bc2-b519-59978c56e212`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:17:18,928::task::990::TaskManager.Task::(_decref) Task=`ff516a60-8676-4bc2-b519-59978c56e212`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:17:18,998::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:19,023::task::1185::TaskManager.Task::(prepare) Task=`ff516a60-8676-4bc2-b519-59978c56e212`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:19,023::task::595::TaskManager.Task::(_updateState) Task=`ff516a60-8676-4bc2-b519-59978c56e212`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:17:19,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:17:19,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:17:19,025::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:17:19,040::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:17:19,040::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:17:19,041::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:17:19,041::task::990::TaskManager.Task::(_decref) Task=`ff516a60-8676-4bc2-b519-59978c56e212`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:17:20,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:20,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564181 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:22,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:22,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559834 s, 18.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:24,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:24,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0668105 s, 15.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:17:25,499::task::595::TaskManager.Task::(_updateState) Task=`871119fd-70c4-460e-af9d-9959a9c88020`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:17:25,500::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:17:25,500::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00151182', 'lastCheck': '6.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:17:25,500::task::1185::TaskManager.Task::(prepare) Task=`871119fd-70c4-460e-af9d-9959a9c88020`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00151182', 'lastCheck': '6.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:17:25,501::task::595::TaskManager.Task::(_updateState) Task=`871119fd-70c4-460e-af9d-9959a9c88020`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:17:25,501::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:17:25,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:17:25,501::task::990::TaskManager.Task::(_decref) Task=`871119fd-70c4-460e-af9d-9959a9c88020`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:17:26,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:26,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111095 s, 9.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:28,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:17:29,104::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-26::DEBUG::2014-08-21 12:17:29,105::task::595::TaskManager.Task::(_updateState) Task=`775114f7-7bb1-4ede-8915-dcfd1fb6d7c9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:17:29,106::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:17:29,107::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:17:29,108::task::1185::TaskManager.Task::(prepare) Task=`775114f7-7bb1-4ede-8915-dcfd1fb6d7c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:17:29,109::task::595::TaskManager.Task::(_updateState) Task=`775114f7-7bb1-4ede-8915-dcfd1fb6d7c9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:17:29,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:17:29,110::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:17:29,110::task::990::TaskManager.Task::(_decref) Task=`775114f7-7bb1-4ede-8915-dcfd1fb6d7c9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:17:29,135::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:17:29,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 12:17:29,175::task::595::TaskManager.Task::(_updateState) Task=`d5f6fa27-36d4-4104-a740-c9ae00cefd9c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:17:29,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:17:29,177::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5a3ab9e9-715a-4d4b-85c4-51190608b700`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:17:29,179::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:17:29,181::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:17:29,181::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5a3ab9e9-715a-4d4b-85c4-51190608b700`::Granted request
>Thread-34::DEBUG::2014-08-21 12:17:29,184::task::827::TaskManager.Task::(resourceAcquired) Task=`d5f6fa27-36d4-4104-a740-c9ae00cefd9c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:17:29,185::task::990::TaskManager.Task::(_decref) Task=`d5f6fa27-36d4-4104-a740-c9ae00cefd9c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:17:29,528::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:29,543::task::1185::TaskManager.Task::(prepare) Task=`d5f6fa27-36d4-4104-a740-c9ae00cefd9c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:29,544::task::595::TaskManager.Task::(_updateState) Task=`d5f6fa27-36d4-4104-a740-c9ae00cefd9c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:17:29,544::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:17:29,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:17:29,546::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:17:29,547::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:17:29,547::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:17:29,548::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:17:29,548::task::990::TaskManager.Task::(_decref) Task=`d5f6fa27-36d4-4104-a740-c9ae00cefd9c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:17:29,381::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0594543 s, 8.4 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:29,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.911334 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:31,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:32,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.948173 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:36,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:36,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.505574 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:38,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:17:39,663::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-26::DEBUG::2014-08-21 12:17:39,664::task::595::TaskManager.Task::(_updateState) Task=`17baccaf-cc10-49de-b0ab-25ac790e6714`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:17:39,665::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:17:39,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:17:39,665::task::1185::TaskManager.Task::(prepare) Task=`17baccaf-cc10-49de-b0ab-25ac790e6714`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:17:39,666::task::595::TaskManager.Task::(_updateState) Task=`17baccaf-cc10-49de-b0ab-25ac790e6714`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:17:39,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:17:39,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:17:39,666::task::990::TaskManager.Task::(_decref) Task=`17baccaf-cc10-49de-b0ab-25ac790e6714`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:17:39,671::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-34::DEBUG::2014-08-21 12:17:39,671::task::595::TaskManager.Task::(_updateState) Task=`b67094ad-3659-4813-8cbc-d6f4e3b716b2`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:17:39,671::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:17:39,672::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b194b6ff-6a34-4b58-8e24-8335c9ed39ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:17:39,672::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:17:39,673::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:17:39,673::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b194b6ff-6a34-4b58-8e24-8335c9ed39ec`::Granted request
>Thread-34::DEBUG::2014-08-21 12:17:39,675::task::827::TaskManager.Task::(resourceAcquired) Task=`b67094ad-3659-4813-8cbc-d6f4e3b716b2`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:17:39,675::task::990::TaskManager.Task::(_decref) Task=`b67094ad-3659-4813-8cbc-d6f4e3b716b2`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:17:39,678::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:39,679::task::1185::TaskManager.Task::(prepare) Task=`b67094ad-3659-4813-8cbc-d6f4e3b716b2`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:39,679::task::595::TaskManager.Task::(_updateState) Task=`b67094ad-3659-4813-8cbc-d6f4e3b716b2`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:17:39,679::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:17:39,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:17:39,680::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:17:39,680::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:17:39,680::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:17:39,680::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:17:39,680::task::990::TaskManager.Task::(_decref) Task=`b67094ad-3659-4813-8cbc-d6f4e3b716b2`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:17:39,832::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:39,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.808574 s, 1.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:17:39,876::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0137386 s, 36.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:41,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:42,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0824945 s, 12.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:17:42,627::task::595::TaskManager.Task::(_updateState) Task=`b3b7f2e4-9531-4b12-ab6a-331d22e724c1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:17:42,628::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:17:42,628::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0137386', 'lastCheck': '2.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:17:42,629::task::1185::TaskManager.Task::(prepare) Task=`b3b7f2e4-9531-4b12-ab6a-331d22e724c1`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0137386', 'lastCheck': '2.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:17:42,629::task::595::TaskManager.Task::(_updateState) Task=`b3b7f2e4-9531-4b12-ab6a-331d22e724c1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:17:42,629::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:17:42,629::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:17:42,629::task::990::TaskManager.Task::(_decref) Task=`b3b7f2e4-9531-4b12-ab6a-331d22e724c1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:17:44,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:46,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.11775 s, 484 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:48,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:48,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538422 s, 19.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:17:49,717::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-26::DEBUG::2014-08-21 12:17:49,718::task::595::TaskManager.Task::(_updateState) Task=`80f67359-7893-4a7e-ab72-7ade6ae757b7`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:17:49,718::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:17:49,719::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:17:49,719::task::1185::TaskManager.Task::(prepare) Task=`80f67359-7893-4a7e-ab72-7ade6ae757b7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:17:49,720::task::595::TaskManager.Task::(_updateState) Task=`80f67359-7893-4a7e-ab72-7ade6ae757b7`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:17:49,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:17:49,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:17:49,720::task::990::TaskManager.Task::(_decref) Task=`80f67359-7893-4a7e-ab72-7ade6ae757b7`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:17:49,756::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 12:17:49,757::task::595::TaskManager.Task::(_updateState) Task=`00bad3f6-e6b1-4f87-9cf5-cc9f06326fc6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:17:49,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:17:49,758::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`72febdd8-83ba-465e-a38e-2723f91af548`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:17:49,775::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:17:49,876::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:17:49,877::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`72febdd8-83ba-465e-a38e-2723f91af548`::Granted request
>Thread-34::DEBUG::2014-08-21 12:17:49,877::task::827::TaskManager.Task::(resourceAcquired) Task=`00bad3f6-e6b1-4f87-9cf5-cc9f06326fc6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:17:49,878::task::990::TaskManager.Task::(_decref) Task=`00bad3f6-e6b1-4f87-9cf5-cc9f06326fc6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:17:49,883::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:49,884::task::1185::TaskManager.Task::(prepare) Task=`00bad3f6-e6b1-4f87-9cf5-cc9f06326fc6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:17:49,884::task::595::TaskManager.Task::(_updateState) Task=`00bad3f6-e6b1-4f87-9cf5-cc9f06326fc6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:17:49,885::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:17:49,885::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:17:49,894::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:17:49,898::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:17:49,898::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:17:49,898::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:17:49,899::task::990::TaskManager.Task::(_decref) Task=`00bad3f6-e6b1-4f87-9cf5-cc9f06326fc6`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:17:50,009::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:17:50,033::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00043479 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:50,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:54,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.86887 s, 548 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:17:56,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:57,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0764492 s, 13.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:17:59,509::task::595::TaskManager.Task::(_updateState) Task=`631f83ef-e4d2-4b55-9597-bc7dc1eb3f0e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:17:59,510::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:17:59,511::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043479', 'lastCheck': '9.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:17:59,511::task::1185::TaskManager.Task::(prepare) Task=`631f83ef-e4d2-4b55-9597-bc7dc1eb3f0e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043479', 'lastCheck': '9.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:17:59,511::task::595::TaskManager.Task::(_updateState) Task=`631f83ef-e4d2-4b55-9597-bc7dc1eb3f0e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:17:59,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:17:59,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:17:59,512::task::990::TaskManager.Task::(_decref) Task=`631f83ef-e4d2-4b55-9597-bc7dc1eb3f0e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:17:59,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:17:59,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.141414 s, 7.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:18:00,078::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-26::DEBUG::2014-08-21 12:18:00,079::task::595::TaskManager.Task::(_updateState) Task=`3d4d3e17-9235-409c-a5bc-affb5b688e34`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:18:00,091::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:18:00,094::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:00,096::task::1185::TaskManager.Task::(prepare) Task=`3d4d3e17-9235-409c-a5bc-affb5b688e34`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:00,098::task::595::TaskManager.Task::(_updateState) Task=`3d4d3e17-9235-409c-a5bc-affb5b688e34`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:18:00,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:18:00,102::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:18:00,105::task::990::TaskManager.Task::(_decref) Task=`3d4d3e17-9235-409c-a5bc-affb5b688e34`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:18:00,123::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-34::DEBUG::2014-08-21 12:18:00,129::task::595::TaskManager.Task::(_updateState) Task=`81358309-04b8-433d-9c67-e764cf39001c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:18:00,134::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 12:18:00,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:18:00,160::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d120ae9f-862a-43ae-b2b8-e9e1243b725e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:18:00,273::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:18:00,284::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:18:00,288::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d120ae9f-862a-43ae-b2b8-e9e1243b725e`::Granted request
>Thread-34::DEBUG::2014-08-21 12:18:00,363::task::827::TaskManager.Task::(resourceAcquired) Task=`81358309-04b8-433d-9c67-e764cf39001c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:18:00,380::task::990::TaskManager.Task::(_decref) Task=`81358309-04b8-433d-9c67-e764cf39001c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:18:00,469::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:00,470::task::1185::TaskManager.Task::(prepare) Task=`81358309-04b8-433d-9c67-e764cf39001c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:00,471::task::595::TaskManager.Task::(_updateState) Task=`81358309-04b8-433d-9c67-e764cf39001c`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 12:18:00,510::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000562616 s, 885 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:18:00,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:18:00,555::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:18:00,567::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:18:00,569::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:18:00,570::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:18:00,570::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:18:00,570::task::990::TaskManager.Task::(_decref) Task=`81358309-04b8-433d-9c67-e764cf39001c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:18:01,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:02,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.1406 s, 7.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:04,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:04,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.115501 s, 8.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:06,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:06,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128145 s, 8.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:08,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:08,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.184114 s, 5.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:18:10,578::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-26::DEBUG::2014-08-21 12:18:10,703::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-26::DEBUG::2014-08-21 12:18:10,741::task::595::TaskManager.Task::(_updateState) Task=`f4bd4d64-19f0-4987-8162-20f87815bca3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:18:10,762::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 12:18:10,765::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:18:10,780::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 12:18:10,798::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 12:18:10,803::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 12:18:10,804::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 12:18:10,804::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-26::INFO::2014-08-21 12:18:10,809::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:10,810::task::1185::TaskManager.Task::(prepare) Task=`f4bd4d64-19f0-4987-8162-20f87815bca3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:10,810::task::595::TaskManager.Task::(_updateState) Task=`f4bd4d64-19f0-4987-8162-20f87815bca3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:18:10,811::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:18:10,811::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:18:10,811::task::990::TaskManager.Task::(_decref) Task=`f4bd4d64-19f0-4987-8162-20f87815bca3`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:18:10,827::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:18:10,855::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-34::DEBUG::2014-08-21 12:18:10,856::task::595::TaskManager.Task::(_updateState) Task=`12631d28-6094-4f31-8795-1952a785531c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:18:10,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:18:10,910::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`61fb5d54-b71e-4de5-a50a-02afd3105e02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:18:10,917::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 12:18:10,897::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00247053 s, 202 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:18:10,922::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:18:10,934::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`61fb5d54-b71e-4de5-a50a-02afd3105e02`::Granted request
>Thread-34::DEBUG::2014-08-21 12:18:10,966::task::827::TaskManager.Task::(resourceAcquired) Task=`12631d28-6094-4f31-8795-1952a785531c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:18:10,967::task::990::TaskManager.Task::(_decref) Task=`12631d28-6094-4f31-8795-1952a785531c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:18:11,001::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:11,036::task::1185::TaskManager.Task::(prepare) Task=`12631d28-6094-4f31-8795-1952a785531c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:11,036::task::595::TaskManager.Task::(_updateState) Task=`12631d28-6094-4f31-8795-1952a785531c`::moving from state preparing -> state finished
>Dummy-33::DEBUG::2014-08-21 12:18:11,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:18:11,170::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:18:11,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:18:11,184::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:18:11,184::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:18:11,184::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:18:11,185::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:18:11,185::task::990::TaskManager.Task::(_decref) Task=`12631d28-6094-4f31-8795-1952a785531c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:18:11,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10117 s, 10.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:13,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:13,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.14641 s, 7.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:18:14,676::task::595::TaskManager.Task::(_updateState) Task=`07898b81-46fe-4b65-b6df-bbf35a1bc71b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:18:14,676::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:18:14,677::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00247053', 'lastCheck': '3.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:18:14,677::task::1185::TaskManager.Task::(prepare) Task=`07898b81-46fe-4b65-b6df-bbf35a1bc71b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00247053', 'lastCheck': '3.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:18:14,677::task::595::TaskManager.Task::(_updateState) Task=`07898b81-46fe-4b65-b6df-bbf35a1bc71b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:18:14,677::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:18:14,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:18:14,678::task::990::TaskManager.Task::(_decref) Task=`07898b81-46fe-4b65-b6df-bbf35a1bc71b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:18:15,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:15,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0739133 s, 13.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:17,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:18,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.540941 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:20,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:20,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499525 s, 20.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:18:21,198::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:18:21,300::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00600623 s, 82.9 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:18:21,303::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-26::DEBUG::2014-08-21 12:18:21,305::task::595::TaskManager.Task::(_updateState) Task=`409d80f6-4120-4f2c-ada8-ee0bdbc9cd93`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:18:21,305::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:18:21,306::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:21,307::task::1185::TaskManager.Task::(prepare) Task=`409d80f6-4120-4f2c-ada8-ee0bdbc9cd93`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:21,307::task::595::TaskManager.Task::(_updateState) Task=`409d80f6-4120-4f2c-ada8-ee0bdbc9cd93`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:18:21,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:18:21,308::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:18:21,308::task::990::TaskManager.Task::(_decref) Task=`409d80f6-4120-4f2c-ada8-ee0bdbc9cd93`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:18:21,477::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-34::DEBUG::2014-08-21 12:18:21,481::task::595::TaskManager.Task::(_updateState) Task=`7430c7ee-098c-4728-ab0c-69f0c9e0634e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:18:21,483::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:18:21,488::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9675ae41-cd89-40b0-8700-45c452d358b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:18:21,489::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:18:21,491::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:18:21,494::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9675ae41-cd89-40b0-8700-45c452d358b7`::Granted request
>Thread-34::DEBUG::2014-08-21 12:18:21,512::task::827::TaskManager.Task::(resourceAcquired) Task=`7430c7ee-098c-4728-ab0c-69f0c9e0634e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:18:21,515::task::990::TaskManager.Task::(_decref) Task=`7430c7ee-098c-4728-ab0c-69f0c9e0634e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:18:21,571::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:21,572::task::1185::TaskManager.Task::(prepare) Task=`7430c7ee-098c-4728-ab0c-69f0c9e0634e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:21,572::task::595::TaskManager.Task::(_updateState) Task=`7430c7ee-098c-4728-ab0c-69f0c9e0634e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:18:21,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:18:21,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:18:21,573::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:18:21,573::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:18:21,573::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:18:21,573::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:18:21,574::task::990::TaskManager.Task::(_decref) Task=`7430c7ee-098c-4728-ab0c-69f0c9e0634e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:18:22,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:22,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0547617 s, 18.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:24,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:27,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.89996 s, 539 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:29,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:29,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0591486 s, 17.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:18:30,699::task::595::TaskManager.Task::(_updateState) Task=`78c9812a-17ba-489c-8787-6652633da633`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:18:30,700::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:18:30,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00600623', 'lastCheck': '9.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:18:30,701::task::1185::TaskManager.Task::(prepare) Task=`78c9812a-17ba-489c-8787-6652633da633`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00600623', 'lastCheck': '9.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:18:30,701::task::595::TaskManager.Task::(_updateState) Task=`78c9812a-17ba-489c-8787-6652633da633`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:18:30,702::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:18:30,702::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:18:30,703::task::990::TaskManager.Task::(_decref) Task=`78c9812a-17ba-489c-8787-6652633da633`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:18:31,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:18:31,612::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-26::DEBUG::2014-08-21 12:18:31,613::task::595::TaskManager.Task::(_updateState) Task=`ff2d2504-18c2-4e39-bd6d-1f17bbe1b910`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:18:31,627::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:18:31,691::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:31,744::task::1185::TaskManager.Task::(prepare) Task=`ff2d2504-18c2-4e39-bd6d-1f17bbe1b910`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:31,745::task::595::TaskManager.Task::(_updateState) Task=`ff2d2504-18c2-4e39-bd6d-1f17bbe1b910`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:18:31,746::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:18:31,776::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:18:31,995::task::990::TaskManager.Task::(_decref) Task=`ff2d2504-18c2-4e39-bd6d-1f17bbe1b910`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:18:32,615::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:18:32,779::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000634999 s, 784 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:18:32,910::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-34::DEBUG::2014-08-21 12:18:32,911::task::595::TaskManager.Task::(_updateState) Task=`fff616ed-71ad-4a15-8c96-2e2f1b5b5ba4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:18:32,912::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:18:32,944::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6a77bbf2-da20-43ce-a946-6d41a075c053`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:18:32,945::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:18:32,945::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:18:32,946::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`6a77bbf2-da20-43ce-a946-6d41a075c053`::Granted request
>Thread-34::DEBUG::2014-08-21 12:18:32,986::task::827::TaskManager.Task::(resourceAcquired) Task=`fff616ed-71ad-4a15-8c96-2e2f1b5b5ba4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:18:33,062::task::990::TaskManager.Task::(_decref) Task=`fff616ed-71ad-4a15-8c96-2e2f1b5b5ba4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:18:34,454::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:34,455::task::1185::TaskManager.Task::(prepare) Task=`fff616ed-71ad-4a15-8c96-2e2f1b5b5ba4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:34,461::task::595::TaskManager.Task::(_updateState) Task=`fff616ed-71ad-4a15-8c96-2e2f1b5b5ba4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:18:34,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:18:34,470::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:18:34,486::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:18:34,925::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:18:34,934::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:18:34,940::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:18:34,950::task::990::TaskManager.Task::(_decref) Task=`fff616ed-71ad-4a15-8c96-2e2f1b5b5ba4`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:18:39,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.96856 s, 129 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:41,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:43,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.58167 s, 647 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:18:45,547::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:18:45,569::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00061705 s, 807 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:45,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:45,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0809403 s, 12.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:18:46,008::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-26::DEBUG::2014-08-21 12:18:46,009::task::595::TaskManager.Task::(_updateState) Task=`da9d06dc-d9ad-4e8c-85cb-9fe7e13c0d4b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:18:46,010::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:18:46,010::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:46,010::task::1185::TaskManager.Task::(prepare) Task=`da9d06dc-d9ad-4e8c-85cb-9fe7e13c0d4b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:46,011::task::595::TaskManager.Task::(_updateState) Task=`da9d06dc-d9ad-4e8c-85cb-9fe7e13c0d4b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:18:46,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:18:46,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:18:46,012::task::990::TaskManager.Task::(_decref) Task=`da9d06dc-d9ad-4e8c-85cb-9fe7e13c0d4b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:18:46,016::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3218e183]
>Thread-34::DEBUG::2014-08-21 12:18:46,017::task::595::TaskManager.Task::(_updateState) Task=`6e3064dc-552a-4282-83ae-0fba24486a70`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:18:46,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:18:46,018::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac26d1ea-2bc8-4e71-8865-dc8a877c22eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:18:46,019::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:18:46,019::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:18:46,019::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ac26d1ea-2bc8-4e71-8865-dc8a877c22eb`::Granted request
>Thread-34::DEBUG::2014-08-21 12:18:46,020::task::827::TaskManager.Task::(resourceAcquired) Task=`6e3064dc-552a-4282-83ae-0fba24486a70`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:18:46,020::task::990::TaskManager.Task::(_decref) Task=`6e3064dc-552a-4282-83ae-0fba24486a70`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:18:46,026::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:46,026::task::1185::TaskManager.Task::(prepare) Task=`6e3064dc-552a-4282-83ae-0fba24486a70`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:46,027::task::595::TaskManager.Task::(_updateState) Task=`6e3064dc-552a-4282-83ae-0fba24486a70`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:18:46,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:18:46,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:18:46,028::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:18:46,029::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:18:46,029::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:18:46,029::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:18:46,029::task::990::TaskManager.Task::(_decref) Task=`6e3064dc-552a-4282-83ae-0fba24486a70`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:18:47,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:47,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0777004 s, 13.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:18:48,846::task::595::TaskManager.Task::(_updateState) Task=`c61636c4-0428-4abe-9a53-6d61793d8737`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:18:48,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:18:48,847::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061705', 'lastCheck': '3.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:18:48,847::task::1185::TaskManager.Task::(prepare) Task=`c61636c4-0428-4abe-9a53-6d61793d8737`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061705', 'lastCheck': '3.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:18:48,847::task::595::TaskManager.Task::(_updateState) Task=`c61636c4-0428-4abe-9a53-6d61793d8737`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:18:48,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:18:48,848::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:18:48,921::task::990::TaskManager.Task::(_decref) Task=`c61636c4-0428-4abe-9a53-6d61793d8737`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:18:50,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:51,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110191 s, 9.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:53,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:53,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.097729 s, 10.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:55,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:18:55,671::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:18:55,814::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00162222 s, 307 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:18:55,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.233409 s, 4.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:18:56,054::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-26::DEBUG::2014-08-21 12:18:56,055::task::595::TaskManager.Task::(_updateState) Task=`43b5b94e-be69-4fc0-8cee-e76e0d0e83af`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:18:56,056::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:18:56,057::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:56,057::task::1185::TaskManager.Task::(prepare) Task=`43b5b94e-be69-4fc0-8cee-e76e0d0e83af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:18:56,058::task::595::TaskManager.Task::(_updateState) Task=`43b5b94e-be69-4fc0-8cee-e76e0d0e83af`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:18:56,058::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:18:56,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:18:56,059::task::990::TaskManager.Task::(_decref) Task=`43b5b94e-be69-4fc0-8cee-e76e0d0e83af`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:18:56,064::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2fca199f]
>Thread-34::DEBUG::2014-08-21 12:18:56,065::task::595::TaskManager.Task::(_updateState) Task=`5771c75d-e8d7-40df-b5cc-6feaa6baf6fa`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:18:56,065::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:18:56,066::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`111c0286-d598-4afa-8c8e-94c5aed6d894`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:18:56,066::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:18:56,067::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:18:56,067::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`111c0286-d598-4afa-8c8e-94c5aed6d894`::Granted request
>Thread-34::DEBUG::2014-08-21 12:18:56,068::task::827::TaskManager.Task::(resourceAcquired) Task=`5771c75d-e8d7-40df-b5cc-6feaa6baf6fa`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:18:56,068::task::990::TaskManager.Task::(_decref) Task=`5771c75d-e8d7-40df-b5cc-6feaa6baf6fa`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:18:56,073::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:56,074::task::1185::TaskManager.Task::(prepare) Task=`5771c75d-e8d7-40df-b5cc-6feaa6baf6fa`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:18:56,074::task::595::TaskManager.Task::(_updateState) Task=`5771c75d-e8d7-40df-b5cc-6feaa6baf6fa`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:18:56,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:18:56,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:18:56,075::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:18:56,076::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:18:56,076::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:18:56,076::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:18:56,077::task::990::TaskManager.Task::(_decref) Task=`5771c75d-e8d7-40df-b5cc-6feaa6baf6fa`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:18:57,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:18:58,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0981435 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:00,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:00,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.113536 s, 9.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:02,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:02,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.219748 s, 4.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:04,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:05,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.114382 s, 9.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:19:05,863::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:19:05,883::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000754238 s, 660 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:19:06,102::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-26::DEBUG::2014-08-21 12:19:06,103::task::595::TaskManager.Task::(_updateState) Task=`e39c8b70-af33-46d5-b183-b69609fa7a61`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:19:06,103::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:19:06,104::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:19:06,104::task::1185::TaskManager.Task::(prepare) Task=`e39c8b70-af33-46d5-b183-b69609fa7a61`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:19:06,104::task::595::TaskManager.Task::(_updateState) Task=`e39c8b70-af33-46d5-b183-b69609fa7a61`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:19:06,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:19:06,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:19:06,105::task::990::TaskManager.Task::(_decref) Task=`e39c8b70-af33-46d5-b183-b69609fa7a61`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:19:06,110::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [58f03c06]
>Thread-34::DEBUG::2014-08-21 12:19:06,111::task::595::TaskManager.Task::(_updateState) Task=`a9e1eb04-b849-4811-ad60-9f859c379d06`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:19:06,111::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:19:06,112::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`19d73586-6173-4989-9674-8fed90f3cdcd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:19:06,112::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:19:06,112::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:19:06,113::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`19d73586-6173-4989-9674-8fed90f3cdcd`::Granted request
>Thread-34::DEBUG::2014-08-21 12:19:06,113::task::827::TaskManager.Task::(resourceAcquired) Task=`a9e1eb04-b849-4811-ad60-9f859c379d06`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:19:06,113::task::990::TaskManager.Task::(_decref) Task=`a9e1eb04-b849-4811-ad60-9f859c379d06`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:19:06,118::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:19:06,118::task::1185::TaskManager.Task::(prepare) Task=`a9e1eb04-b849-4811-ad60-9f859c379d06`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:19:06,119::task::595::TaskManager.Task::(_updateState) Task=`a9e1eb04-b849-4811-ad60-9f859c379d06`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:19:06,119::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:19:06,119::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:19:06,120::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:19:06,120::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:19:06,120::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:19:06,120::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:19:06,120::task::990::TaskManager.Task::(_decref) Task=`a9e1eb04-b849-4811-ad60-9f859c379d06`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:19:06,406::task::595::TaskManager.Task::(_updateState) Task=`dd7f6dde-0e86-442c-b4c4-7208c4ebd48a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:19:06,407::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:19:06,407::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754238', 'lastCheck': '0.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:19:06,407::task::1185::TaskManager.Task::(prepare) Task=`dd7f6dde-0e86-442c-b4c4-7208c4ebd48a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754238', 'lastCheck': '0.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:19:06,407::task::595::TaskManager.Task::(_updateState) Task=`dd7f6dde-0e86-442c-b4c4-7208c4ebd48a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:19:06,408::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:19:06,408::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:19:06,408::task::990::TaskManager.Task::(_decref) Task=`dd7f6dde-0e86-442c-b4c4-7208c4ebd48a`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:19:07,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:07,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121488 s, 8.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:09,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:09,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0924175 s, 11.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:11,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:12,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.077513 s, 13.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:14,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:14,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0604461 s, 16.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:19:16,031::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:19:16,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0151069 s, 33.0 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:19:16,295::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-26::DEBUG::2014-08-21 12:19:16,297::task::595::TaskManager.Task::(_updateState) Task=`abc09c8d-1f4e-4348-a48c-e9bb4520a8d9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:19:16,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:19:16,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:19:16,308::task::1185::TaskManager.Task::(prepare) Task=`abc09c8d-1f4e-4348-a48c-e9bb4520a8d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:19:16,309::task::595::TaskManager.Task::(_updateState) Task=`abc09c8d-1f4e-4348-a48c-e9bb4520a8d9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:19:16,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:19:16,316::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:19:16,316::task::990::TaskManager.Task::(_decref) Task=`abc09c8d-1f4e-4348-a48c-e9bb4520a8d9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:19:16,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:19:16,591::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-34::DEBUG::2014-08-21 12:19:16,592::task::595::TaskManager.Task::(_updateState) Task=`fb0da557-2773-4940-9e34-df57b115c254`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:19:16,593::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:19:16,594::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ad5eed6c-81d2-48b4-a39a-3344eac7997c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:19:16,594::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:19:16,595::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:19:16,595::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ad5eed6c-81d2-48b4-a39a-3344eac7997c`::Granted request
>Thread-34::DEBUG::2014-08-21 12:19:16,597::task::827::TaskManager.Task::(resourceAcquired) Task=`fb0da557-2773-4940-9e34-df57b115c254`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:19:16,597::task::990::TaskManager.Task::(_decref) Task=`fb0da557-2773-4940-9e34-df57b115c254`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:19:16,604::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:19:16,604::task::1185::TaskManager.Task::(prepare) Task=`fb0da557-2773-4940-9e34-df57b115c254`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:19:16,605::task::595::TaskManager.Task::(_updateState) Task=`fb0da557-2773-4940-9e34-df57b115c254`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:19:16,605::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:19:16,605::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:19:16,606::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:19:16,606::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:19:16,606::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:19:16,615::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:19:16,616::task::990::TaskManager.Task::(_decref) Task=`fb0da557-2773-4940-9e34-df57b115c254`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:19:25,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 9.32819 s, 110 kB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:19:26,408::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:19:26,427::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000489655 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:27,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:28,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.194632 s, 5.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:19:28,258::task::595::TaskManager.Task::(_updateState) Task=`252a7203-2a11-435d-9fc2-89628b91482e`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:19:28,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:19:28,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489655', 'lastCheck': '1.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:19:28,259::task::1185::TaskManager.Task::(prepare) Task=`252a7203-2a11-435d-9fc2-89628b91482e`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489655', 'lastCheck': '1.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:19:28,260::task::595::TaskManager.Task::(_updateState) Task=`252a7203-2a11-435d-9fc2-89628b91482e`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:19:28,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:19:28,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:19:28,261::task::990::TaskManager.Task::(_decref) Task=`252a7203-2a11-435d-9fc2-89628b91482e`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:19:30,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:30,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.690256 s, 1.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:32,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:19:38,076::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-13::DEBUG::2014-08-21 12:19:38,114::task::595::TaskManager.Task::(_updateState) Task=`30717a54-03e1-4506-b207-f2a8badbdb24`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:19:38,120::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:19:38,128::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:19:38,132::task::1185::TaskManager.Task::(prepare) Task=`30717a54-03e1-4506-b207-f2a8badbdb24`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:19:38,136::task::595::TaskManager.Task::(_updateState) Task=`30717a54-03e1-4506-b207-f2a8badbdb24`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:19:38,137::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:19:38,138::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:19:38,140::task::990::TaskManager.Task::(_decref) Task=`30717a54-03e1-4506-b207-f2a8badbdb24`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:19:38,155::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [60129546]
>Thread-34::DEBUG::2014-08-21 12:19:38,156::task::595::TaskManager.Task::(_updateState) Task=`123b2a34-820c-42e8-9f8d-de9779315c9f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:19:38,156::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:19:38,157::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`390ebf08-0a61-47d0-b3b4-5afca367f431`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:19:38,157::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:19:38,157::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:19:38,157::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`390ebf08-0a61-47d0-b3b4-5afca367f431`::Granted request
>Thread-34::DEBUG::2014-08-21 12:19:38,158::task::827::TaskManager.Task::(resourceAcquired) Task=`123b2a34-820c-42e8-9f8d-de9779315c9f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:19:38,158::task::990::TaskManager.Task::(_decref) Task=`123b2a34-820c-42e8-9f8d-de9779315c9f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:19:38,162::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:19:38,163::task::1185::TaskManager.Task::(prepare) Task=`123b2a34-820c-42e8-9f8d-de9779315c9f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:19:38,163::task::595::TaskManager.Task::(_updateState) Task=`123b2a34-820c-42e8-9f8d-de9779315c9f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:19:38,163::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:19:38,163::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:19:38,164::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:19:38,164::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:19:38,164::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:19:38,164::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:19:38,165::task::990::TaskManager.Task::(_decref) Task=`123b2a34-820c-42e8-9f8d-de9779315c9f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:19:38,328::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:19:38,416::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00129687 s, 384 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:38,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.505186 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:40,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:40,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0577165 s, 17.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:42,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:42,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0658222 s, 15.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:44,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:45,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.418556 s, 2.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:19:47,165::task::595::TaskManager.Task::(_updateState) Task=`98787094-fbf1-447e-a7fd-793f82871958`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:19:47,166::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:19:47,167::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129687', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:19:47,167::task::1185::TaskManager.Task::(prepare) Task=`98787094-fbf1-447e-a7fd-793f82871958`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129687', 'lastCheck': '8.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:19:47,167::task::595::TaskManager.Task::(_updateState) Task=`98787094-fbf1-447e-a7fd-793f82871958`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:19:47,168::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:19:47,168::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:19:47,168::task::990::TaskManager.Task::(_decref) Task=`98787094-fbf1-447e-a7fd-793f82871958`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:19:47,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:19:48,314::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-13::DEBUG::2014-08-21 12:19:48,316::task::595::TaskManager.Task::(_updateState) Task=`02a62abe-36bc-4776-8d7c-31298c375168`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:19:49,627::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:19:49,647::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:19:50,206::task::1185::TaskManager.Task::(prepare) Task=`02a62abe-36bc-4776-8d7c-31298c375168`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:19:50,221::task::595::TaskManager.Task::(_updateState) Task=`02a62abe-36bc-4776-8d7c-31298c375168`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:19:50,231::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:19:50,238::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:19:50,251::task::990::TaskManager.Task::(_decref) Task=`02a62abe-36bc-4776-8d7c-31298c375168`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:19:50,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 12:19:50,354::task::595::TaskManager.Task::(_updateState) Task=`46b412b7-5637-40fd-9fd9-f8e45b4a50d9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:19:50,381::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:19:50,421::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`89a21e79-793e-4e93-b70b-e3bf8e9bed42`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:19:50,424::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:19:50,439::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:19:50,446::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`89a21e79-793e-4e93-b70b-e3bf8e9bed42`::Granted request
>Thread-34::DEBUG::2014-08-21 12:19:50,459::task::827::TaskManager.Task::(resourceAcquired) Task=`46b412b7-5637-40fd-9fd9-f8e45b4a50d9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:19:50,463::task::990::TaskManager.Task::(_decref) Task=`46b412b7-5637-40fd-9fd9-f8e45b4a50d9`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:19:50,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 12:19:50,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:19:50,658::task::1185::TaskManager.Task::(prepare) Task=`46b412b7-5637-40fd-9fd9-f8e45b4a50d9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-15::DEBUG::2014-08-21 12:19:50,722::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00194581 s, 256 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:19:50,809::task::595::TaskManager.Task::(_updateState) Task=`46b412b7-5637-40fd-9fd9-f8e45b4a50d9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:19:50,810::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:19:50,810::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:19:50,894::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:19:50,915::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:19:50,915::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:19:50,916::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:19:50,917::task::990::TaskManager.Task::(_decref) Task=`46b412b7-5637-40fd-9fd9-f8e45b4a50d9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:19:51,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.92725 s, 261 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:53,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:54,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.514794 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:56,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:56,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.19885 s, 5.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:19:58,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:19:58,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101555 s, 10.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:00,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:00,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0543251 s, 18.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:20:01,064::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-26::DEBUG::2014-08-21 12:20:01,065::task::595::TaskManager.Task::(_updateState) Task=`067994e0-d9ca-4ce2-b6f0-1bdab52383f9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:20:01,065::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:20:01,066::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:01,066::task::1185::TaskManager.Task::(prepare) Task=`067994e0-d9ca-4ce2-b6f0-1bdab52383f9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:01,066::task::595::TaskManager.Task::(_updateState) Task=`067994e0-d9ca-4ce2-b6f0-1bdab52383f9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:20:01,067::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:20:01,067::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:20:01,067::task::990::TaskManager.Task::(_decref) Task=`067994e0-d9ca-4ce2-b6f0-1bdab52383f9`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:20:01,072::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 12:20:01,073::task::595::TaskManager.Task::(_updateState) Task=`e0e60ab3-6b3d-4599-beaf-e56812d46b96`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:20:01,073::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:20:01,074::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`89b28443-a9ad-4b68-ad4c-d198af0dbafd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:20:01,075::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:20:01,075::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:20:01,075::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`89b28443-a9ad-4b68-ad4c-d198af0dbafd`::Granted request
>Thread-34::DEBUG::2014-08-21 12:20:01,076::task::827::TaskManager.Task::(resourceAcquired) Task=`e0e60ab3-6b3d-4599-beaf-e56812d46b96`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:20:01,076::task::990::TaskManager.Task::(_decref) Task=`e0e60ab3-6b3d-4599-beaf-e56812d46b96`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:20:01,081::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:01,081::task::1185::TaskManager.Task::(prepare) Task=`e0e60ab3-6b3d-4599-beaf-e56812d46b96`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:01,082::task::595::TaskManager.Task::(_updateState) Task=`e0e60ab3-6b3d-4599-beaf-e56812d46b96`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:20:01,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:20:01,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:20:01,083::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:20:01,083::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:20:01,083::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:20:01,083::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:20:01,084::task::990::TaskManager.Task::(_decref) Task=`e0e60ab3-6b3d-4599-beaf-e56812d46b96`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:20:01,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:20:01,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00114614 s, 435 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:20:02,428::task::595::TaskManager.Task::(_updateState) Task=`c8cf6c99-1be9-43ff-898e-9660d917513b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:20:02,429::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:20:02,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114614', 'lastCheck': '1.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:20:02,432::task::1185::TaskManager.Task::(prepare) Task=`c8cf6c99-1be9-43ff-898e-9660d917513b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114614', 'lastCheck': '1.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:20:02,433::task::595::TaskManager.Task::(_updateState) Task=`c8cf6c99-1be9-43ff-898e-9660d917513b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:20:02,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:20:02,436::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:20:02,436::task::990::TaskManager.Task::(_decref) Task=`c8cf6c99-1be9-43ff-898e-9660d917513b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:20:02,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:03,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.269873 s, 3.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:05,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:05,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0528578 s, 19.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:07,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:07,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0662948 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:09,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:09,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477023 s, 21.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:20:11,102::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-26::DEBUG::2014-08-21 12:20:11,104::task::595::TaskManager.Task::(_updateState) Task=`3ac55ae1-c7b1-4254-a3ce-809cd0de84cd`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:20:11,105::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:20:11,107::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:11,108::task::1185::TaskManager.Task::(prepare) Task=`3ac55ae1-c7b1-4254-a3ce-809cd0de84cd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:11,108::task::595::TaskManager.Task::(_updateState) Task=`3ac55ae1-c7b1-4254-a3ce-809cd0de84cd`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:20:11,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:20:11,110::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:20:11,110::task::990::TaskManager.Task::(_decref) Task=`3ac55ae1-c7b1-4254-a3ce-809cd0de84cd`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:20:11,125::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-34::DEBUG::2014-08-21 12:20:11,140::task::595::TaskManager.Task::(_updateState) Task=`53bf14bf-2eb2-498f-9d6d-2c238ca406f4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:20:11,151::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:20:11,153::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`efaf9a8a-e6bb-46c2-9dca-7cf2608d6cfa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:20:11,153::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:20:11,153::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:20:11,154::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`efaf9a8a-e6bb-46c2-9dca-7cf2608d6cfa`::Granted request
>Thread-34::DEBUG::2014-08-21 12:20:11,154::task::827::TaskManager.Task::(resourceAcquired) Task=`53bf14bf-2eb2-498f-9d6d-2c238ca406f4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:20:11,154::task::990::TaskManager.Task::(_decref) Task=`53bf14bf-2eb2-498f-9d6d-2c238ca406f4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:20:11,159::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:11,159::task::1185::TaskManager.Task::(prepare) Task=`53bf14bf-2eb2-498f-9d6d-2c238ca406f4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:11,160::task::595::TaskManager.Task::(_updateState) Task=`53bf14bf-2eb2-498f-9d6d-2c238ca406f4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:20:11,160::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:20:11,160::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:20:11,160::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:20:11,161::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:20:11,161::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:20:11,161::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:20:11,162::task::990::TaskManager.Task::(_decref) Task=`53bf14bf-2eb2-498f-9d6d-2c238ca406f4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:20:11,429::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:20:11,448::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000514431 s, 968 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:11,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:12,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0732297 s, 14.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:14,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:14,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106396 s, 9.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:16,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:20:17,866::task::595::TaskManager.Task::(_updateState) Task=`a7bb4ec9-3e6d-4c2f-912a-f36326034a85`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:20:17,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:20:17,880::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514431', 'lastCheck': '6.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:20:17,924::task::1185::TaskManager.Task::(prepare) Task=`a7bb4ec9-3e6d-4c2f-912a-f36326034a85`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514431', 'lastCheck': '6.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:20:17,925::task::595::TaskManager.Task::(_updateState) Task=`a7bb4ec9-3e6d-4c2f-912a-f36326034a85`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:20:17,925::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:20:17,926::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:20:17,927::task::990::TaskManager.Task::(_decref) Task=`a7bb4ec9-3e6d-4c2f-912a-f36326034a85`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:20:18,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.56811 s, 653 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:20,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:20,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0946567 s, 10.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:20:21,185::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-26::DEBUG::2014-08-21 12:20:21,188::task::595::TaskManager.Task::(_updateState) Task=`94fe2584-6c06-432a-9598-27140d330af3`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:20:21,188::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:20:21,189::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:21,189::task::1185::TaskManager.Task::(prepare) Task=`94fe2584-6c06-432a-9598-27140d330af3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:21,190::task::595::TaskManager.Task::(_updateState) Task=`94fe2584-6c06-432a-9598-27140d330af3`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:20:21,190::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:20:21,190::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:20:21,191::task::990::TaskManager.Task::(_decref) Task=`94fe2584-6c06-432a-9598-27140d330af3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:20:21,201::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-34::DEBUG::2014-08-21 12:20:21,203::task::595::TaskManager.Task::(_updateState) Task=`ea724d2c-0fae-4a43-9b40-8f0fb9aaa450`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:20:21,203::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:20:21,205::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cef2743d-8342-47e7-9412-59094377455b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:20:21,206::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:20:21,206::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:20:21,207::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cef2743d-8342-47e7-9412-59094377455b`::Granted request
>Thread-34::DEBUG::2014-08-21 12:20:21,207::task::827::TaskManager.Task::(resourceAcquired) Task=`ea724d2c-0fae-4a43-9b40-8f0fb9aaa450`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:20:21,208::task::990::TaskManager.Task::(_decref) Task=`ea724d2c-0fae-4a43-9b40-8f0fb9aaa450`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:20:21,215::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:21,215::task::1185::TaskManager.Task::(prepare) Task=`ea724d2c-0fae-4a43-9b40-8f0fb9aaa450`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:21,216::task::595::TaskManager.Task::(_updateState) Task=`ea724d2c-0fae-4a43-9b40-8f0fb9aaa450`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:20:21,216::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:20:21,216::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:20:21,217::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:20:21,217::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:20:21,218::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:20:21,218::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:20:21,219::task::990::TaskManager.Task::(_decref) Task=`ea724d2c-0fae-4a43-9b40-8f0fb9aaa450`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:20:21,513::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:20:21,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00743876 s, 66.9 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:26,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:26,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.151218 s, 6.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:28,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:28,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.22325 s, 4.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:31,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:31,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100702 s, 10.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:20:31,254::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-26::DEBUG::2014-08-21 12:20:31,257::task::595::TaskManager.Task::(_updateState) Task=`eb8c0be5-63fb-4291-87e6-791064cfb043`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:20:31,258::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:20:31,260::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:31,261::task::1185::TaskManager.Task::(prepare) Task=`eb8c0be5-63fb-4291-87e6-791064cfb043`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:31,262::task::595::TaskManager.Task::(_updateState) Task=`eb8c0be5-63fb-4291-87e6-791064cfb043`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:20:31,263::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:20:31,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:20:31,265::task::990::TaskManager.Task::(_decref) Task=`eb8c0be5-63fb-4291-87e6-791064cfb043`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:20:31,278::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [195baaca]
>Thread-34::DEBUG::2014-08-21 12:20:31,280::task::595::TaskManager.Task::(_updateState) Task=`a58c68ec-7a21-4e50-85d0-5eb19ce31a45`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:20:31,282::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:20:31,284::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cd995543-0e47-4609-94f9-194f9334ba5d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:20:31,285::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:20:31,285::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:20:31,285::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cd995543-0e47-4609-94f9-194f9334ba5d`::Granted request
>Thread-34::DEBUG::2014-08-21 12:20:31,286::task::827::TaskManager.Task::(resourceAcquired) Task=`a58c68ec-7a21-4e50-85d0-5eb19ce31a45`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:20:31,286::task::990::TaskManager.Task::(_decref) Task=`a58c68ec-7a21-4e50-85d0-5eb19ce31a45`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:20:31,290::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:31,290::task::1185::TaskManager.Task::(prepare) Task=`a58c68ec-7a21-4e50-85d0-5eb19ce31a45`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:31,290::task::595::TaskManager.Task::(_updateState) Task=`a58c68ec-7a21-4e50-85d0-5eb19ce31a45`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:20:31,290::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:20:31,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:20:31,291::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:20:31,291::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:20:31,291::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:20:31,292::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:20:31,292::task::990::TaskManager.Task::(_decref) Task=`a58c68ec-7a21-4e50-85d0-5eb19ce31a45`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:20:33,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:33,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530209 s, 19.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:35,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:20:35,556::task::595::TaskManager.Task::(_updateState) Task=`8b93dcc3-6b45-4315-8687-e2624fa37d33`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:20:35,557::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:20:35,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00743876', 'lastCheck': '9.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:20:35,558::task::1185::TaskManager.Task::(prepare) Task=`8b93dcc3-6b45-4315-8687-e2624fa37d33`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00743876', 'lastCheck': '9.1', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:20:35,558::task::595::TaskManager.Task::(_updateState) Task=`8b93dcc3-6b45-4315-8687-e2624fa37d33`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:20:35,559::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:20:35,559::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:20:35,559::task::990::TaskManager.Task::(_decref) Task=`8b93dcc3-6b45-4315-8687-e2624fa37d33`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:20:35,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.210179 s, 4.9 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:20:36,515::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:20:36,531::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000650479 s, 766 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:37,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:38,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.238844 s, 4.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:20:40,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:20:40,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.289413 s, 3.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:20:41,309::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-26::DEBUG::2014-08-21 12:20:41,311::task::595::TaskManager.Task::(_updateState) Task=`9bb2243b-a429-46c4-97e6-2b96cd8b5a17`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:20:41,311::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:20:41,312::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:41,313::task::1185::TaskManager.Task::(prepare) Task=`9bb2243b-a429-46c4-97e6-2b96cd8b5a17`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:20:41,313::task::595::TaskManager.Task::(_updateState) Task=`9bb2243b-a429-46c4-97e6-2b96cd8b5a17`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:20:41,313::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:20:41,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:20:41,314::task::990::TaskManager.Task::(_decref) Task=`9bb2243b-a429-46c4-97e6-2b96cd8b5a17`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:20:41,332::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5263f19]
>Thread-34::DEBUG::2014-08-21 12:20:41,333::task::595::TaskManager.Task::(_updateState) Task=`e4421b43-7d66-4327-a25a-1787876e3f0d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:20:41,334::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:20:41,359::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`69d97d48-79a6-40bb-9168-6c5961107c6e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:20:41,359::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:20:41,360::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:20:41,360::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`69d97d48-79a6-40bb-9168-6c5961107c6e`::Granted request
>Thread-34::DEBUG::2014-08-21 12:20:41,361::task::827::TaskManager.Task::(resourceAcquired) Task=`e4421b43-7d66-4327-a25a-1787876e3f0d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:20:41,361::task::990::TaskManager.Task::(_decref) Task=`e4421b43-7d66-4327-a25a-1787876e3f0d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:20:41,368::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:41,384::task::1185::TaskManager.Task::(prepare) Task=`e4421b43-7d66-4327-a25a-1787876e3f0d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:41,385::task::595::TaskManager.Task::(_updateState) Task=`e4421b43-7d66-4327-a25a-1787876e3f0d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:20:41,385::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:20:41,385::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:20:41,386::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:20:41,387::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:20:41,387::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:20:41,387::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:20:41,388::task::990::TaskManager.Task::(_decref) Task=`e4421b43-7d66-4327-a25a-1787876e3f0d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:20:42,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:20:56,440::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-13::DEBUG::2014-08-21 12:20:56,499::task::595::TaskManager.Task::(_updateState) Task=`b574dede-26f1-49d8-a34c-453fd4b14130`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:20:56,509::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:20:56,522::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:20:56,526::task::1185::TaskManager.Task::(prepare) Task=`b574dede-26f1-49d8-a34c-453fd4b14130`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:20:56,531::task::595::TaskManager.Task::(_updateState) Task=`b574dede-26f1-49d8-a34c-453fd4b14130`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:20:56,534::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:20:56,540::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:20:56,544::task::990::TaskManager.Task::(_decref) Task=`b574dede-26f1-49d8-a34c-453fd4b14130`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:20:56,567::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7eeb3702]
>Thread-34::DEBUG::2014-08-21 12:20:56,571::task::595::TaskManager.Task::(_updateState) Task=`fef0bf99-a7a5-4278-b0fa-d0913764fd17`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:20:56,574::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 12:20:56,575::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:20:59,006::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ea2e9ff2-b62e-4cb9-9531-4195cb3fb906`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:20:59,016::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:20:59,024::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:20:59,026::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ea2e9ff2-b62e-4cb9-9531-4195cb3fb906`::Granted request
>Thread-34::DEBUG::2014-08-21 12:20:59,042::task::827::TaskManager.Task::(resourceAcquired) Task=`fef0bf99-a7a5-4278-b0fa-d0913764fd17`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:20:59,048::task::990::TaskManager.Task::(_decref) Task=`fef0bf99-a7a5-4278-b0fa-d0913764fd17`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:20:59,067::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0012183 s, 409 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 12:20:59,140::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:59,141::task::1185::TaskManager.Task::(prepare) Task=`fef0bf99-a7a5-4278-b0fa-d0913764fd17`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:20:59,143::task::595::TaskManager.Task::(_updateState) Task=`fef0bf99-a7a5-4278-b0fa-d0913764fd17`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:20:59,144::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:20:59,145::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:20:59,151::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:20:59,153::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:20:59,155::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:20:59,156::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:20:59,158::task::990::TaskManager.Task::(_decref) Task=`fef0bf99-a7a5-4278-b0fa-d0913764fd17`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:20:59,505::task::595::TaskManager.Task::(_updateState) Task=`0767b97d-6845-4c88-8f26-f82f0891cdc7`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:20:59,507::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:20:59,508::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012183', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:20:59,509::task::1185::TaskManager.Task::(prepare) Task=`0767b97d-6845-4c88-8f26-f82f0891cdc7`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012183', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:20:59,511::task::595::TaskManager.Task::(_updateState) Task=`0767b97d-6845-4c88-8f26-f82f0891cdc7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:20:59,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:20:59,513::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:20:59,514::task::990::TaskManager.Task::(_decref) Task=`0767b97d-6845-4c88-8f26-f82f0891cdc7`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:20:59,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 16.6403 s, 61.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:01,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:01,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0879204 s, 11.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:03,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:04,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0665948 s, 15.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:06,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:06,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.06486 s, 15.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:08,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:08,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.158035 s, 6.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:21:09,179::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:21:09,197::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000643954 s, 773 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:21:09,230::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-13::DEBUG::2014-08-21 12:21:09,231::task::595::TaskManager.Task::(_updateState) Task=`333a1b69-0378-40f9-907c-2e644926bb79`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:21:09,232::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:21:09,232::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:09,232::task::1185::TaskManager.Task::(prepare) Task=`333a1b69-0378-40f9-907c-2e644926bb79`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:09,232::task::595::TaskManager.Task::(_updateState) Task=`333a1b69-0378-40f9-907c-2e644926bb79`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:21:09,233::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:21:09,233::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:21:09,233::task::990::TaskManager.Task::(_decref) Task=`333a1b69-0378-40f9-907c-2e644926bb79`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:21:09,252::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 12:21:09,255::task::595::TaskManager.Task::(_updateState) Task=`e1207518-3e89-411c-a74c-48599e4d3439`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:21:09,256::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:21:09,257::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`afcbd55f-b695-457d-9ea9-e20fce377994`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:21:09,257::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:21:09,259::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:21:09,260::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`afcbd55f-b695-457d-9ea9-e20fce377994`::Granted request
>Thread-34::DEBUG::2014-08-21 12:21:09,261::task::827::TaskManager.Task::(resourceAcquired) Task=`e1207518-3e89-411c-a74c-48599e4d3439`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:21:09,261::task::990::TaskManager.Task::(_decref) Task=`e1207518-3e89-411c-a74c-48599e4d3439`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:21:09,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:09,268::task::1185::TaskManager.Task::(prepare) Task=`e1207518-3e89-411c-a74c-48599e4d3439`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:09,268::task::595::TaskManager.Task::(_updateState) Task=`e1207518-3e89-411c-a74c-48599e4d3439`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:21:09,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:21:09,275::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:21:09,277::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:21:09,277::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:21:09,278::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:21:09,278::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:21:09,280::task::990::TaskManager.Task::(_decref) Task=`e1207518-3e89-411c-a74c-48599e4d3439`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:21:10,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:10,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.230184 s, 4.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:12,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:13,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.884523 s, 1.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:21:14,688::task::595::TaskManager.Task::(_updateState) Task=`6d576736-f37b-4605-9b5b-50aea160b7ed`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:21:14,689::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:21:14,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643954', 'lastCheck': '5.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:21:14,690::task::1185::TaskManager.Task::(prepare) Task=`6d576736-f37b-4605-9b5b-50aea160b7ed`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643954', 'lastCheck': '5.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:21:14,690::task::595::TaskManager.Task::(_updateState) Task=`6d576736-f37b-4605-9b5b-50aea160b7ed`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:21:14,691::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:21:14,691::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:21:14,692::task::990::TaskManager.Task::(_decref) Task=`6d576736-f37b-4605-9b5b-50aea160b7ed`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:21:15,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:16,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.553589 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:18,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:18,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100975 s, 10.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:21:19,237::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:21:19,309::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00519709 s, 95.8 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:21:19,327::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-13::DEBUG::2014-08-21 12:21:19,329::task::595::TaskManager.Task::(_updateState) Task=`4e8e50f5-a1bf-44a9-8615-245a6a8a0cf1`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:21:20,247::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:21:20,249::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:20,250::task::1185::TaskManager.Task::(prepare) Task=`4e8e50f5-a1bf-44a9-8615-245a6a8a0cf1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:20,250::task::595::TaskManager.Task::(_updateState) Task=`4e8e50f5-a1bf-44a9-8615-245a6a8a0cf1`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:21:20,251::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:21:20,587::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:21:20,588::task::990::TaskManager.Task::(_decref) Task=`4e8e50f5-a1bf-44a9-8615-245a6a8a0cf1`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:21:20,799::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e135cf1]
>Thread-34::DEBUG::2014-08-21 12:21:20,800::task::595::TaskManager.Task::(_updateState) Task=`eee0e1f3-5710-49b4-aa00-d5398f8b4872`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:21:20,801::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:21:20,802::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f6a10fa9-55a1-43ed-bc6b-68382deffbaf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:21:20,802::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:21:20,803::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:21:20,804::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f6a10fa9-55a1-43ed-bc6b-68382deffbaf`::Granted request
>Thread-34::DEBUG::2014-08-21 12:21:20,822::task::827::TaskManager.Task::(resourceAcquired) Task=`eee0e1f3-5710-49b4-aa00-d5398f8b4872`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:21:20,823::task::990::TaskManager.Task::(_decref) Task=`eee0e1f3-5710-49b4-aa00-d5398f8b4872`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:21:20,844::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:20,845::task::1185::TaskManager.Task::(prepare) Task=`eee0e1f3-5710-49b4-aa00-d5398f8b4872`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:20,845::task::595::TaskManager.Task::(_updateState) Task=`eee0e1f3-5710-49b4-aa00-d5398f8b4872`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:21:20,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:21:20,846::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:21:20,847::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:21:20,848::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:21:20,848::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:21:20,848::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:21:20,849::task::990::TaskManager.Task::(_decref) Task=`eee0e1f3-5710-49b4-aa00-d5398f8b4872`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:21:20,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:21,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.126136 s, 8.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:23,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:23,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0539947 s, 19.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:25,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:25,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.522305 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:27,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:29,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.610775 s, 1.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:21:29,630::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:21:29,644::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000908855 s, 548 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:21:30,001::task::595::TaskManager.Task::(_updateState) Task=`72fb7286-60c0-43c6-b95a-36aa4a00214a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:21:30,001::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:21:30,001::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000908855', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:21:30,001::task::1185::TaskManager.Task::(prepare) Task=`72fb7286-60c0-43c6-b95a-36aa4a00214a`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000908855', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:21:30,002::task::595::TaskManager.Task::(_updateState) Task=`72fb7286-60c0-43c6-b95a-36aa4a00214a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:21:30,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:21:30,002::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:21:30,002::task::990::TaskManager.Task::(_decref) Task=`72fb7286-60c0-43c6-b95a-36aa4a00214a`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:21:30,974::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 12:21:30,977::task::595::TaskManager.Task::(_updateState) Task=`7f128661-22b1-4661-8848-32e921aa26ce`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:21:30,978::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:21:30,979::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:30,980::task::1185::TaskManager.Task::(prepare) Task=`7f128661-22b1-4661-8848-32e921aa26ce`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:30,981::task::595::TaskManager.Task::(_updateState) Task=`7f128661-22b1-4661-8848-32e921aa26ce`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:21:30,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:21:30,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:21:30,982::task::990::TaskManager.Task::(_decref) Task=`7f128661-22b1-4661-8848-32e921aa26ce`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:21:30,990::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 12:21:30,991::task::595::TaskManager.Task::(_updateState) Task=`a3193861-5542-4699-bd54-f730cf38f062`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:21:30,992::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:21:30,993::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`735e59f6-a444-4ecc-ab4f-659c9aebfc15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:21:30,993::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:21:30,993::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:21:30,994::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`735e59f6-a444-4ecc-ab4f-659c9aebfc15`::Granted request
>Thread-34::DEBUG::2014-08-21 12:21:30,994::task::827::TaskManager.Task::(resourceAcquired) Task=`a3193861-5542-4699-bd54-f730cf38f062`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:21:30,995::task::990::TaskManager.Task::(_decref) Task=`a3193861-5542-4699-bd54-f730cf38f062`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:21:31,003::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:31,003::task::1185::TaskManager.Task::(prepare) Task=`a3193861-5542-4699-bd54-f730cf38f062`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:31,007::task::595::TaskManager.Task::(_updateState) Task=`a3193861-5542-4699-bd54-f730cf38f062`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:21:31,008::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:21:31,008::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:21:31,009::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:21:31,010::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:21:31,010::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:21:31,011::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:21:31,011::task::990::TaskManager.Task::(_decref) Task=`a3193861-5542-4699-bd54-f730cf38f062`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:21:31,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:31,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0632962 s, 16.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:33,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:21:40,480::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:21:40,614::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0118611 s, 42.0 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:40,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 7.46661 s, 137 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:21:41,034::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-13::DEBUG::2014-08-21 12:21:41,036::task::595::TaskManager.Task::(_updateState) Task=`63a2b6fd-c509-4ecd-b433-429d24908e3a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:21:41,036::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:21:41,037::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:41,037::task::1185::TaskManager.Task::(prepare) Task=`63a2b6fd-c509-4ecd-b433-429d24908e3a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:41,038::task::595::TaskManager.Task::(_updateState) Task=`63a2b6fd-c509-4ecd-b433-429d24908e3a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:21:41,038::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:21:41,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:21:41,039::task::990::TaskManager.Task::(_decref) Task=`63a2b6fd-c509-4ecd-b433-429d24908e3a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:21:41,048::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-34::DEBUG::2014-08-21 12:21:41,048::task::595::TaskManager.Task::(_updateState) Task=`51601c3b-67dd-4cab-a3cf-23464eac72be`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:21:41,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:21:41,050::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8aa014d4-eabd-4cde-a50f-390c44384456`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:21:41,050::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:21:41,051::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:21:41,051::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`8aa014d4-eabd-4cde-a50f-390c44384456`::Granted request
>Thread-34::DEBUG::2014-08-21 12:21:41,052::task::827::TaskManager.Task::(resourceAcquired) Task=`51601c3b-67dd-4cab-a3cf-23464eac72be`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:21:41,053::task::990::TaskManager.Task::(_decref) Task=`51601c3b-67dd-4cab-a3cf-23464eac72be`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:21:41,060::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:41,060::task::1185::TaskManager.Task::(prepare) Task=`51601c3b-67dd-4cab-a3cf-23464eac72be`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:41,061::task::595::TaskManager.Task::(_updateState) Task=`51601c3b-67dd-4cab-a3cf-23464eac72be`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:21:41,061::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:21:41,062::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:21:41,062::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:21:41,063::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:21:41,063::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:21:41,063::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:21:41,064::task::990::TaskManager.Task::(_decref) Task=`51601c3b-67dd-4cab-a3cf-23464eac72be`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:21:42,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:43,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903841 s, 11.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:45,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:45,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.096399 s, 10.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:47,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:47,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.073647 s, 13.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:21:48,420::task::595::TaskManager.Task::(_updateState) Task=`47b5e0b7-e783-43e3-8a1a-0a8eab51c249`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:21:48,421::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:21:48,422::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118611', 'lastCheck': '7.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:21:48,422::task::1185::TaskManager.Task::(prepare) Task=`47b5e0b7-e783-43e3-8a1a-0a8eab51c249`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118611', 'lastCheck': '7.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:21:48,423::task::595::TaskManager.Task::(_updateState) Task=`47b5e0b7-e783-43e3-8a1a-0a8eab51c249`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:21:48,423::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:21:48,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:21:48,424::task::990::TaskManager.Task::(_decref) Task=`47b5e0b7-e783-43e3-8a1a-0a8eab51c249`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:21:49,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:21:50,887::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:21:50,929::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000696722 s, 715 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:21:51,102::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-13::DEBUG::2014-08-21 12:21:51,108::task::595::TaskManager.Task::(_updateState) Task=`9b0e5dde-118c-4060-abf8-cf8405ced950`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:21:51,111::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:21:51,115::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:51,117::task::1185::TaskManager.Task::(prepare) Task=`9b0e5dde-118c-4060-abf8-cf8405ced950`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:21:51,121::task::595::TaskManager.Task::(_updateState) Task=`9b0e5dde-118c-4060-abf8-cf8405ced950`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:21:51,124::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:21:51,127::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:21:51,130::task::990::TaskManager.Task::(_decref) Task=`9b0e5dde-118c-4060-abf8-cf8405ced950`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:21:51,156::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 12:21:51,162::task::595::TaskManager.Task::(_updateState) Task=`34452291-e876-4525-8582-3e8e9e1cae06`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:21:51,167::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:21:51,212::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a53f4db8-7e63-42a7-a037-17329c921773`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:21:51,214::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:21:51,218::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:21:51,219::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a53f4db8-7e63-42a7-a037-17329c921773`::Granted request
>Thread-34::DEBUG::2014-08-21 12:21:51,236::task::827::TaskManager.Task::(resourceAcquired) Task=`34452291-e876-4525-8582-3e8e9e1cae06`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:21:51,239::task::990::TaskManager.Task::(_decref) Task=`34452291-e876-4525-8582-3e8e9e1cae06`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:21:51,255::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:51,257::task::1185::TaskManager.Task::(prepare) Task=`34452291-e876-4525-8582-3e8e9e1cae06`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:21:51,258::task::595::TaskManager.Task::(_updateState) Task=`34452291-e876-4525-8582-3e8e9e1cae06`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:21:51,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:21:51,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:21:51,269::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:21:51,275::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:21:51,278::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:21:51,278::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:21:51,281::task::990::TaskManager.Task::(_decref) Task=`34452291-e876-4525-8582-3e8e9e1cae06`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:21:51,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.7219 s, 595 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:53,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:53,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.180772 s, 5.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:21:55,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:21:58,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.18657 s, 468 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:00,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:22:01,002::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:22:01,040::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000966317 s, 515 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:01,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.19721 s, 5.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:22:01,301::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-13::DEBUG::2014-08-21 12:22:01,305::task::595::TaskManager.Task::(_updateState) Task=`32bd37a4-32e5-4069-bac6-6397c75f5177`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:22:01,307::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:22:01,309::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:22:01,310::task::1185::TaskManager.Task::(prepare) Task=`32bd37a4-32e5-4069-bac6-6397c75f5177`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:22:01,311::task::595::TaskManager.Task::(_updateState) Task=`32bd37a4-32e5-4069-bac6-6397c75f5177`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:22:01,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:22:01,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:22:01,314::task::990::TaskManager.Task::(_decref) Task=`32bd37a4-32e5-4069-bac6-6397c75f5177`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:22:01,325::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7deb8020]
>Thread-34::DEBUG::2014-08-21 12:22:01,328::task::595::TaskManager.Task::(_updateState) Task=`d717e032-42d5-4346-aec8-fcea7e3c2c98`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:22:01,329::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:22:01,332::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9e36be71-253e-40f5-982f-114c8b32b432`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:22:01,333::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:22:01,337::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:22:01,338::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9e36be71-253e-40f5-982f-114c8b32b432`::Granted request
>Thread-34::DEBUG::2014-08-21 12:22:01,344::task::827::TaskManager.Task::(resourceAcquired) Task=`d717e032-42d5-4346-aec8-fcea7e3c2c98`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:22:01,346::task::990::TaskManager.Task::(_decref) Task=`d717e032-42d5-4346-aec8-fcea7e3c2c98`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:22:01,377::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:01,379::task::1185::TaskManager.Task::(prepare) Task=`d717e032-42d5-4346-aec8-fcea7e3c2c98`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:01,380::task::595::TaskManager.Task::(_updateState) Task=`d717e032-42d5-4346-aec8-fcea7e3c2c98`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:22:01,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:22:01,383::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:22:01,386::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:22:01,388::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:22:01,389::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:22:01,390::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:22:01,392::task::990::TaskManager.Task::(_decref) Task=`d717e032-42d5-4346-aec8-fcea7e3c2c98`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:22:03,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:22:03,705::task::595::TaskManager.Task::(_updateState) Task=`8a77be24-0993-4c31-95ec-9a584f855363`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:22:03,713::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:22:03,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000966317', 'lastCheck': '2.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:22:03,714::task::1185::TaskManager.Task::(prepare) Task=`8a77be24-0993-4c31-95ec-9a584f855363`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000966317', 'lastCheck': '2.7', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:22:03,715::task::595::TaskManager.Task::(_updateState) Task=`8a77be24-0993-4c31-95ec-9a584f855363`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:22:03,716::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:22:03,716::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:22:03,717::task::990::TaskManager.Task::(_decref) Task=`8a77be24-0993-4c31-95ec-9a584f855363`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:22:03,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.467199 s, 2.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:05,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:06,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.151686 s, 6.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:08,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:10,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.834904 s, 1.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:22:11,730::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-13::DEBUG::2014-08-21 12:22:11,758::task::595::TaskManager.Task::(_updateState) Task=`21e3b14b-9907-469b-8ef2-f452b9aa923c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:22:11,811::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 12:22:11,819::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-13::INFO::2014-08-21 12:22:12,227::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:22:12,229::task::1185::TaskManager.Task::(prepare) Task=`21e3b14b-9907-469b-8ef2-f452b9aa923c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Dummy-33::DEBUG::2014-08-21 12:22:12,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:22:12,413::task::595::TaskManager.Task::(_updateState) Task=`21e3b14b-9907-469b-8ef2-f452b9aa923c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:22:12,414::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:22:12,415::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:22:12,478::task::990::TaskManager.Task::(_decref) Task=`21e3b14b-9907-469b-8ef2-f452b9aa923c`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:22:13,406::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.065897 s, 7.6 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:22:14,468::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [76802b3b]
>Thread-34::DEBUG::2014-08-21 12:22:14,925::task::595::TaskManager.Task::(_updateState) Task=`68b0a17b-35f4-4bd4-960a-00d3ecbbd718`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:22:14,926::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:22:15,265::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`87e370e6-aac9-4e46-915a-37c091d55c9b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:22:15,266::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:22:15,271::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:22:15,271::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`87e370e6-aac9-4e46-915a-37c091d55c9b`::Granted request
>Thread-34::DEBUG::2014-08-21 12:22:15,277::task::827::TaskManager.Task::(resourceAcquired) Task=`68b0a17b-35f4-4bd4-960a-00d3ecbbd718`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:22:15,278::task::990::TaskManager.Task::(_decref) Task=`68b0a17b-35f4-4bd4-960a-00d3ecbbd718`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:22:15,361::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:15,363::task::1185::TaskManager.Task::(prepare) Task=`68b0a17b-35f4-4bd4-960a-00d3ecbbd718`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:15,364::task::595::TaskManager.Task::(_updateState) Task=`68b0a17b-35f4-4bd4-960a-00d3ecbbd718`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:22:15,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:22:15,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:22:15,367::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:22:15,367::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:22:15,368::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:22:15,368::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:22:15,369::task::990::TaskManager.Task::(_decref) Task=`68b0a17b-35f4-4bd4-960a-00d3ecbbd718`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:22:15,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.21604 s, 318 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:17,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:18,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.323261 s, 3.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:20,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:20,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530779 s, 19.3 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:22:21,867::task::595::TaskManager.Task::(_updateState) Task=`8feae1de-710b-4f3a-bcce-6ce8b6b3661b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:22:21,868::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:22:21,868::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.065897', 'lastCheck': '6.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:22:21,868::task::1185::TaskManager.Task::(prepare) Task=`8feae1de-710b-4f3a-bcce-6ce8b6b3661b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.065897', 'lastCheck': '6.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:22:21,869::task::595::TaskManager.Task::(_updateState) Task=`8feae1de-710b-4f3a-bcce-6ce8b6b3661b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:22:21,869::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:22:21,869::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:22:21,869::task::990::TaskManager.Task::(_decref) Task=`8feae1de-710b-4f3a-bcce-6ce8b6b3661b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:22:22,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:23,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0617142 s, 16.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:22:29,791::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Dummy-33::DEBUG::2014-08-21 12:22:30,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:22:33,325::task::595::TaskManager.Task::(_updateState) Task=`bcb2d621-6263-4c42-9987-fcaa131d5105`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:22:33,326::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:22:33,467::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:22:33,468::task::1185::TaskManager.Task::(prepare) Task=`bcb2d621-6263-4c42-9987-fcaa131d5105`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:22:33,468::task::595::TaskManager.Task::(_updateState) Task=`bcb2d621-6263-4c42-9987-fcaa131d5105`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:22:33,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:22:33,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:22:33,477::task::990::TaskManager.Task::(_decref) Task=`bcb2d621-6263-4c42-9987-fcaa131d5105`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:22:34,547::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [23943f0e]
>Thread-34::DEBUG::2014-08-21 12:22:34,549::task::595::TaskManager.Task::(_updateState) Task=`9a2de5a1-fd3d-4ea9-8b66-8ecbf41fdb41`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:22:34,768::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:22:34,836::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ed720fc1-9ef3-4d16-8667-c552827fbdf6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:22:34,837::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:22:34,838::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:22:34,838::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ed720fc1-9ef3-4d16-8667-c552827fbdf6`::Granted request
>Thread-34::DEBUG::2014-08-21 12:22:34,840::task::827::TaskManager.Task::(resourceAcquired) Task=`9a2de5a1-fd3d-4ea9-8b66-8ecbf41fdb41`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:22:34,840::task::990::TaskManager.Task::(_decref) Task=`9a2de5a1-fd3d-4ea9-8b66-8ecbf41fdb41`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:22:35,745::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:35,746::task::1185::TaskManager.Task::(prepare) Task=`9a2de5a1-fd3d-4ea9-8b66-8ecbf41fdb41`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:35,766::task::595::TaskManager.Task::(_updateState) Task=`9a2de5a1-fd3d-4ea9-8b66-8ecbf41fdb41`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:22:35,770::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:22:35,771::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:22:35,775::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:22:35,776::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:22:35,777::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:22:35,777::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:22:35,778::task::990::TaskManager.Task::(_decref) Task=`9a2de5a1-fd3d-4ea9-8b66-8ecbf41fdb41`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:22:36,555::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:22:36,633::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00704463 s, 70.7 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:37,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.06566 s, 252 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:39,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:40,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.297027 s, 3.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:42,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:44,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.34318 s, 762 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:46,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:46,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0839601 s, 12.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:22:46,575::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-13::DEBUG::2014-08-21 12:22:46,576::task::595::TaskManager.Task::(_updateState) Task=`1d2cfe3f-3f2c-4582-b4fb-5f71fe5378b3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:22:46,576::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:22:46,577::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:22:46,577::task::1185::TaskManager.Task::(prepare) Task=`1d2cfe3f-3f2c-4582-b4fb-5f71fe5378b3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:22:46,577::task::595::TaskManager.Task::(_updateState) Task=`1d2cfe3f-3f2c-4582-b4fb-5f71fe5378b3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:22:46,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:22:46,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:22:46,578::task::990::TaskManager.Task::(_decref) Task=`1d2cfe3f-3f2c-4582-b4fb-5f71fe5378b3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:22:46,582::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 12:22:46,583::task::595::TaskManager.Task::(_updateState) Task=`92f345f4-f31c-4919-8a56-86121e32fd9f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:22:46,583::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:22:46,584::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3daa25a2-5243-4089-814a-83ea70c45994`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:22:46,584::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:22:46,584::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:22:46,585::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3daa25a2-5243-4089-814a-83ea70c45994`::Granted request
>Thread-34::DEBUG::2014-08-21 12:22:46,588::task::827::TaskManager.Task::(resourceAcquired) Task=`92f345f4-f31c-4919-8a56-86121e32fd9f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:22:46,588::task::990::TaskManager.Task::(_decref) Task=`92f345f4-f31c-4919-8a56-86121e32fd9f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:22:46,596::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967301632', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:46,597::task::1185::TaskManager.Task::(prepare) Task=`92f345f4-f31c-4919-8a56-86121e32fd9f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967301632', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:46,597::task::595::TaskManager.Task::(_updateState) Task=`92f345f4-f31c-4919-8a56-86121e32fd9f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:22:46,599::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:22:46,599::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:22:46,600::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:22:46,600::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:22:46,600::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:22:46,601::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:22:46,601::task::990::TaskManager.Task::(_decref) Task=`92f345f4-f31c-4919-8a56-86121e32fd9f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:22:46,798::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:22:46,819::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00654901 s, 76.0 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:22:47,180::task::595::TaskManager.Task::(_updateState) Task=`f4eb4f75-4148-4901-ae36-b7b6894c7f26`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:22:47,181::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:22:47,181::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00654901', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:22:47,182::task::1185::TaskManager.Task::(prepare) Task=`f4eb4f75-4148-4901-ae36-b7b6894c7f26`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00654901', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:22:47,182::task::595::TaskManager.Task::(_updateState) Task=`f4eb4f75-4148-4901-ae36-b7b6894c7f26`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:22:47,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:22:47,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:22:47,182::task::990::TaskManager.Task::(_decref) Task=`f4eb4f75-4148-4901-ae36-b7b6894c7f26`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:22:48,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:49,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.408592 s, 2.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:51,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:51,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0811036 s, 12.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:53,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:53,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0590281 s, 17.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:55,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:55,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0581702 s, 17.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:22:56,630::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-13::DEBUG::2014-08-21 12:22:56,631::task::595::TaskManager.Task::(_updateState) Task=`4c8b5755-4b9d-40b5-bbd0-4055d32cda5a`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:22:56,632::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:22:56,632::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:22:56,633::task::1185::TaskManager.Task::(prepare) Task=`4c8b5755-4b9d-40b5-bbd0-4055d32cda5a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:22:56,633::task::595::TaskManager.Task::(_updateState) Task=`4c8b5755-4b9d-40b5-bbd0-4055d32cda5a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:22:56,633::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:22:56,634::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:22:56,634::task::990::TaskManager.Task::(_decref) Task=`4c8b5755-4b9d-40b5-bbd0-4055d32cda5a`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:22:56,649::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5cde4695]
>Thread-34::DEBUG::2014-08-21 12:22:56,650::task::595::TaskManager.Task::(_updateState) Task=`1714ead2-0f87-462d-8a67-08791ffbf464`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:22:56,655::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:22:56,656::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e5468e9e-0ae8-46d9-952a-70cb213cfaac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:22:56,656::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:22:56,657::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:22:56,657::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e5468e9e-0ae8-46d9-952a-70cb213cfaac`::Granted request
>Thread-34::DEBUG::2014-08-21 12:22:56,658::task::827::TaskManager.Task::(resourceAcquired) Task=`1714ead2-0f87-462d-8a67-08791ffbf464`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:22:56,659::task::990::TaskManager.Task::(_decref) Task=`1714ead2-0f87-462d-8a67-08791ffbf464`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:22:56,665::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:56,666::task::1185::TaskManager.Task::(prepare) Task=`1714ead2-0f87-462d-8a67-08791ffbf464`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:22:56,666::task::595::TaskManager.Task::(_updateState) Task=`1714ead2-0f87-462d-8a67-08791ffbf464`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:22:56,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:22:56,667::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:22:56,667::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:22:56,668::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:22:56,668::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:22:56,668::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:22:56,669::task::990::TaskManager.Task::(_decref) Task=`1714ead2-0f87-462d-8a67-08791ffbf464`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:22:57,159::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:22:57,302::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.050651 s, 9.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:57,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:57,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0531098 s, 19.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:22:59,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:22:59,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0637949 s, 16.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:01,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:02,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.390505 s, 2.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:23:02,580::task::595::TaskManager.Task::(_updateState) Task=`74f2d536-a29a-4f0b-881d-86c8e9811c6c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:23:02,581::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:23:02,582::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.050651', 'lastCheck': '5.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:23:02,582::task::1185::TaskManager.Task::(prepare) Task=`74f2d536-a29a-4f0b-881d-86c8e9811c6c`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.050651', 'lastCheck': '5.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:23:02,583::task::595::TaskManager.Task::(_updateState) Task=`74f2d536-a29a-4f0b-881d-86c8e9811c6c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:23:02,583::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:23:02,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:23:02,646::task::990::TaskManager.Task::(_decref) Task=`74f2d536-a29a-4f0b-881d-86c8e9811c6c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:23:04,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:23:06,973::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [461d7334]
>Thread-13::DEBUG::2014-08-21 12:23:07,167::task::595::TaskManager.Task::(_updateState) Task=`a19abbd2-c34b-4bf8-86cc-e17ff2989e6c`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:23:07,241::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:23:07,250::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:23:07,255::task::1185::TaskManager.Task::(prepare) Task=`a19abbd2-c34b-4bf8-86cc-e17ff2989e6c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:23:07,301::task::595::TaskManager.Task::(_updateState) Task=`a19abbd2-c34b-4bf8-86cc-e17ff2989e6c`::moving from state preparing -> state finished
>Dummy-33::DEBUG::2014-08-21 12:23:07,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.460663 s, 2.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:23:07,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:23:07,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:23:07,389::task::990::TaskManager.Task::(_decref) Task=`a19abbd2-c34b-4bf8-86cc-e17ff2989e6c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:23:08,153::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [461d7334]
>Thread-34::DEBUG::2014-08-21 12:23:08,165::task::595::TaskManager.Task::(_updateState) Task=`4943d5f1-2605-433f-99a5-136ef2a9dedc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:23:08,171::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:23:08,183::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b04c4338-082d-4e81-9cc8-4ca7e6fc893f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:23:08,240::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:23:08,380::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:23:08,381::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b04c4338-082d-4e81-9cc8-4ca7e6fc893f`::Granted request
>Thread-34::DEBUG::2014-08-21 12:23:08,593::task::827::TaskManager.Task::(resourceAcquired) Task=`4943d5f1-2605-433f-99a5-136ef2a9dedc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:23:08,594::task::990::TaskManager.Task::(_decref) Task=`4943d5f1-2605-433f-99a5-136ef2a9dedc`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:23:09,036::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:09,041::task::1185::TaskManager.Task::(prepare) Task=`4943d5f1-2605-433f-99a5-136ef2a9dedc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968612352', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:09,042::task::595::TaskManager.Task::(_updateState) Task=`4943d5f1-2605-433f-99a5-136ef2a9dedc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:23:09,046::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:23:09,121::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:23:09,151::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:23:09,166::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:23:09,166::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:23:09,170::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:23:09,173::task::990::TaskManager.Task::(_decref) Task=`4943d5f1-2605-433f-99a5-136ef2a9dedc`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:23:09,304::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:10,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:23:10,892::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0446488 s, 11.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:11,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.766579 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:13,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:13,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.051768 s, 19.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:18,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:23:19,646::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-26::DEBUG::2014-08-21 12:23:19,894::task::595::TaskManager.Task::(_updateState) Task=`214efc57-2357-4d9e-b731-fe76c5d7da2f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:23:19,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:23:19,896::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:23:19,897::task::1185::TaskManager.Task::(prepare) Task=`214efc57-2357-4d9e-b731-fe76c5d7da2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:23:19,898::task::595::TaskManager.Task::(_updateState) Task=`214efc57-2357-4d9e-b731-fe76c5d7da2f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:23:19,904::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:23:19,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:23:19,906::task::990::TaskManager.Task::(_decref) Task=`214efc57-2357-4d9e-b731-fe76c5d7da2f`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:23:20,061::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1923f0b4]
>Thread-34::DEBUG::2014-08-21 12:23:20,066::task::595::TaskManager.Task::(_updateState) Task=`a5971b4a-b541-47fa-8b06-6cd0f68a2957`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:23:20,068::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:23:20,074::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a05b8630-143a-4e98-b554-be96cfbc1420`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:23:20,075::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:23:20,078::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:23:20,079::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a05b8630-143a-4e98-b554-be96cfbc1420`::Granted request
>Thread-34::DEBUG::2014-08-21 12:23:20,084::task::827::TaskManager.Task::(resourceAcquired) Task=`a5971b4a-b541-47fa-8b06-6cd0f68a2957`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:23:20,086::task::990::TaskManager.Task::(_decref) Task=`a5971b4a-b541-47fa-8b06-6cd0f68a2957`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:23:20,129::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:20,133::task::1185::TaskManager.Task::(prepare) Task=`a5971b4a-b541-47fa-8b06-6cd0f68a2957`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:20,136::task::595::TaskManager.Task::(_updateState) Task=`a5971b4a-b541-47fa-8b06-6cd0f68a2957`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:23:20,139::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:23:20,141::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:23:20,146::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:23:20,150::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:23:20,152::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:23:20,154::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:23:20,157::task::990::TaskManager.Task::(_decref) Task=`a5971b4a-b541-47fa-8b06-6cd0f68a2957`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:23:20,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.976962 s, 1.0 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:23:20,975::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:23:20,989::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:23:20,992::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 12:23:21,005::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 12:23:21,009::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 12:23:21,010::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 12:23:21,010::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 12:23:21,034::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:23:21,054::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000482402 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:22,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:23:22,528::task::595::TaskManager.Task::(_updateState) Task=`00680985-7cdf-4194-977a-cc3fb9868b6d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:23:22,531::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:23:22,535::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482402', 'lastCheck': '1.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:23:22,536::task::1185::TaskManager.Task::(prepare) Task=`00680985-7cdf-4194-977a-cc3fb9868b6d`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482402', 'lastCheck': '1.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:23:22,537::task::595::TaskManager.Task::(_updateState) Task=`00680985-7cdf-4194-977a-cc3fb9868b6d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:23:22,538::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:23:22,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:23:22,540::task::990::TaskManager.Task::(_decref) Task=`00680985-7cdf-4194-977a-cc3fb9868b6d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:23:22,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0577903 s, 17.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:24,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:24,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.059316 s, 17.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:26,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:27,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.192662 s, 5.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:29,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:29,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128235 s, 8.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:23:30,184::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-26::DEBUG::2014-08-21 12:23:30,186::task::595::TaskManager.Task::(_updateState) Task=`04cb9b84-bead-4d53-962f-e1259369af0d`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:23:30,187::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:23:30,188::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:23:30,188::task::1185::TaskManager.Task::(prepare) Task=`04cb9b84-bead-4d53-962f-e1259369af0d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:23:30,188::task::595::TaskManager.Task::(_updateState) Task=`04cb9b84-bead-4d53-962f-e1259369af0d`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:23:30,188::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:23:30,188::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:23:30,189::task::990::TaskManager.Task::(_decref) Task=`04cb9b84-bead-4d53-962f-e1259369af0d`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:23:30,193::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [908fdc5]
>Thread-34::DEBUG::2014-08-21 12:23:30,193::task::595::TaskManager.Task::(_updateState) Task=`d75ff25c-834e-4cd8-88de-014cf9624cea`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:23:30,194::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:23:30,194::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`010f5668-5b16-4a86-9093-0a9e23c96bf0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:23:30,195::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:23:30,195::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:23:30,196::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`010f5668-5b16-4a86-9093-0a9e23c96bf0`::Granted request
>Thread-34::DEBUG::2014-08-21 12:23:30,197::task::827::TaskManager.Task::(resourceAcquired) Task=`d75ff25c-834e-4cd8-88de-014cf9624cea`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:23:30,197::task::990::TaskManager.Task::(_decref) Task=`d75ff25c-834e-4cd8-88de-014cf9624cea`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:23:30,203::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:30,203::task::1185::TaskManager.Task::(prepare) Task=`d75ff25c-834e-4cd8-88de-014cf9624cea`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967629312', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:30,204::task::595::TaskManager.Task::(_updateState) Task=`d75ff25c-834e-4cd8-88de-014cf9624cea`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:23:30,204::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:23:30,204::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:23:30,205::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:23:30,205::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:23:30,205::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:23:30,205::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:23:30,206::task::990::TaskManager.Task::(_decref) Task=`d75ff25c-834e-4cd8-88de-014cf9624cea`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:23:31,076::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:23:31,090::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000533843 s, 933 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:31,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:31,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0828272 s, 12.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:33,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:33,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0703877 s, 14.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:35,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:35,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0671773 s, 15.2 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:23:37,685::task::595::TaskManager.Task::(_updateState) Task=`012bc5f7-341b-43e1-ab53-23cee07d921b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:23:37,686::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:23:37,686::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533843', 'lastCheck': '6.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:23:37,686::task::1185::TaskManager.Task::(prepare) Task=`012bc5f7-341b-43e1-ab53-23cee07d921b`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533843', 'lastCheck': '6.6', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:23:37,687::task::595::TaskManager.Task::(_updateState) Task=`012bc5f7-341b-43e1-ab53-23cee07d921b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:23:37,687::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:23:37,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:23:37,688::task::990::TaskManager.Task::(_decref) Task=`012bc5f7-341b-43e1-ab53-23cee07d921b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:23:37,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:38,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541515 s, 18.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:40,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:40,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0678645 s, 15.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:23:40,245::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d519215]
>Thread-26::DEBUG::2014-08-21 12:23:40,247::task::595::TaskManager.Task::(_updateState) Task=`35f902e4-b3bb-408d-b3a5-3f30dd3da370`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:23:40,249::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:23:40,250::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:23:40,251::task::1185::TaskManager.Task::(prepare) Task=`35f902e4-b3bb-408d-b3a5-3f30dd3da370`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:23:40,251::task::595::TaskManager.Task::(_updateState) Task=`35f902e4-b3bb-408d-b3a5-3f30dd3da370`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:23:40,251::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:23:40,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:23:40,253::task::990::TaskManager.Task::(_decref) Task=`35f902e4-b3bb-408d-b3a5-3f30dd3da370`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:23:40,258::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1d519215]
>Thread-34::DEBUG::2014-08-21 12:23:40,259::task::595::TaskManager.Task::(_updateState) Task=`04b5c930-e195-4485-9ba9-975ec91e634e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:23:40,259::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:23:40,260::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5894d0f0-344c-4671-8f86-e1642669824b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:23:40,260::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:23:40,261::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:23:40,261::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5894d0f0-344c-4671-8f86-e1642669824b`::Granted request
>Thread-34::DEBUG::2014-08-21 12:23:40,265::task::827::TaskManager.Task::(resourceAcquired) Task=`04b5c930-e195-4485-9ba9-975ec91e634e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:23:40,266::task::990::TaskManager.Task::(_decref) Task=`04b5c930-e195-4485-9ba9-975ec91e634e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:23:40,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:40,273::task::1185::TaskManager.Task::(prepare) Task=`04b5c930-e195-4485-9ba9-975ec91e634e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:40,273::task::595::TaskManager.Task::(_updateState) Task=`04b5c930-e195-4485-9ba9-975ec91e634e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:23:40,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:23:40,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:23:40,275::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:23:40,275::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:23:40,276::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:23:40,276::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:23:40,276::task::990::TaskManager.Task::(_decref) Task=`04b5c930-e195-4485-9ba9-975ec91e634e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:23:41,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:23:41,133::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00190019 s, 262 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:42,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:42,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505088 s, 20.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:44,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:44,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.2248 s, 4.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:46,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:47,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.537295 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:49,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:23:50,431::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-13::DEBUG::2014-08-21 12:23:50,434::task::595::TaskManager.Task::(_updateState) Task=`ec04c618-339f-44ad-959b-07f21f3eeabe`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:23:50,435::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:23:50,436::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:23:50,437::task::1185::TaskManager.Task::(prepare) Task=`ec04c618-339f-44ad-959b-07f21f3eeabe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:23:50,437::task::595::TaskManager.Task::(_updateState) Task=`ec04c618-339f-44ad-959b-07f21f3eeabe`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:23:50,438::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:23:50,438::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:23:50,438::task::990::TaskManager.Task::(_decref) Task=`ec04c618-339f-44ad-959b-07f21f3eeabe`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:23:50,915::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [12d7b472]
>Thread-34::DEBUG::2014-08-21 12:23:50,918::task::595::TaskManager.Task::(_updateState) Task=`9f3cfce5-7e21-4c54-a067-1013a084235f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:23:50,918::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:23:50,920::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`952f7186-e23a-45d5-82d1-55df836d9fce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:23:50,921::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:23:51,090::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:23:51,091::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`952f7186-e23a-45d5-82d1-55df836d9fce`::Granted request
>Thread-34::DEBUG::2014-08-21 12:23:51,093::task::827::TaskManager.Task::(resourceAcquired) Task=`9f3cfce5-7e21-4c54-a067-1013a084235f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:23:51,276::task::990::TaskManager.Task::(_decref) Task=`9f3cfce5-7e21-4c54-a067-1013a084235f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:23:51,707::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:51,708::task::1185::TaskManager.Task::(prepare) Task=`9f3cfce5-7e21-4c54-a067-1013a084235f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:23:51,708::task::595::TaskManager.Task::(_updateState) Task=`9f3cfce5-7e21-4c54-a067-1013a084235f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:23:51,709::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:23:51,709::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:23:51,710::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-15::DEBUG::2014-08-21 12:23:51,741::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:23:51,711::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:23:51,843::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:23:51,855::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-15::DEBUG::2014-08-21 12:23:51,986::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00804706 s, 61.9 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:23:52,022::task::990::TaskManager.Task::(_decref) Task=`9f3cfce5-7e21-4c54-a067-1013a084235f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:23:52,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.33188 s, 439 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:54,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:23:54,778::task::595::TaskManager.Task::(_updateState) Task=`feaabbeb-8ac4-4f0c-bb6e-5df67dfb5745`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:23:54,783::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:23:54,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00804706', 'lastCheck': '2.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:23:54,787::task::1185::TaskManager.Task::(prepare) Task=`feaabbeb-8ac4-4f0c-bb6e-5df67dfb5745`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00804706', 'lastCheck': '2.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:23:54,790::task::595::TaskManager.Task::(_updateState) Task=`feaabbeb-8ac4-4f0c-bb6e-5df67dfb5745`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:23:54,792::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:23:54,793::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:23:54,795::task::990::TaskManager.Task::(_decref) Task=`feaabbeb-8ac4-4f0c-bb6e-5df67dfb5745`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:23:54,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.60927 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:23:56,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:23:59,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.851211 s, 1.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:24:02,695::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-13::DEBUG::2014-08-21 12:24:02,844::task::595::TaskManager.Task::(_updateState) Task=`c13c5316-1f5f-4ee2-ac9d-ff7c231e92b9`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:24:02,865::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:24:02,866::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:24:02,866::task::1185::TaskManager.Task::(prepare) Task=`c13c5316-1f5f-4ee2-ac9d-ff7c231e92b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:24:02,900::task::595::TaskManager.Task::(_updateState) Task=`c13c5316-1f5f-4ee2-ac9d-ff7c231e92b9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:24:02,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:24:02,959::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:24:02,992::task::990::TaskManager.Task::(_decref) Task=`c13c5316-1f5f-4ee2-ac9d-ff7c231e92b9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:24:03,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:24:03,320::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7786a24c]
>Thread-34::DEBUG::2014-08-21 12:24:03,332::task::595::TaskManager.Task::(_updateState) Task=`c4917e60-7a38-4386-b49c-d22b505db3a1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:24:03,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:24:03,345::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`84df6e27-94a1-4289-ae38-e2da78b62ace`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:24:03,347::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:24:03,351::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:24:03,352::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`84df6e27-94a1-4289-ae38-e2da78b62ace`::Granted request
>Thread-34::DEBUG::2014-08-21 12:24:03,381::task::827::TaskManager.Task::(resourceAcquired) Task=`c4917e60-7a38-4386-b49c-d22b505db3a1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:24:03,390::task::990::TaskManager.Task::(_decref) Task=`c4917e60-7a38-4386-b49c-d22b505db3a1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:24:03,493::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:03,499::task::1185::TaskManager.Task::(prepare) Task=`c4917e60-7a38-4386-b49c-d22b505db3a1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:03,503::task::595::TaskManager.Task::(_updateState) Task=`c4917e60-7a38-4386-b49c-d22b505db3a1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:24:03,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:24:03,519::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:24:03,532::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:24:03,541::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:24:03,544::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:24:03,549::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:24:03,559::task::990::TaskManager.Task::(_decref) Task=`c4917e60-7a38-4386-b49c-d22b505db3a1`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:24:03,614::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:24:03,678::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00192708 s, 258 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:03,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.574961 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:05,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:24:06,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869932 s, 11.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:08,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:24:08,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.361648 s, 2.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:17,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:24:17,098::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-26::DEBUG::2014-08-21 12:24:17,163::task::595::TaskManager.Task::(_updateState) Task=`bfceeb12-5b3d-4671-862a-edd265865e88`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:24:17,177::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:24:17,194::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:24:17,206::task::1185::TaskManager.Task::(prepare) Task=`bfceeb12-5b3d-4671-862a-edd265865e88`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:24:17,220::task::595::TaskManager.Task::(_updateState) Task=`bfceeb12-5b3d-4671-862a-edd265865e88`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:24:17,233::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:24:17,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:24:17,255::task::990::TaskManager.Task::(_decref) Task=`bfceeb12-5b3d-4671-862a-edd265865e88`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:24:17,285::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7c15083d]
>Thread-34::DEBUG::2014-08-21 12:24:17,291::task::595::TaskManager.Task::(_updateState) Task=`6fb21ed7-f5ad-49c4-bf6e-783440887616`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:24:17,297::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:24:17,304::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15a9fcd2-ab4e-433c-ab3d-28afe5c6f283`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:24:17,307::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:24:17,310::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:24:17,312::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`15a9fcd2-ab4e-433c-ab3d-28afe5c6f283`::Granted request
>Thread-34::DEBUG::2014-08-21 12:24:17,320::task::827::TaskManager.Task::(resourceAcquired) Task=`6fb21ed7-f5ad-49c4-bf6e-783440887616`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:24:17,324::task::990::TaskManager.Task::(_decref) Task=`6fb21ed7-f5ad-49c4-bf6e-783440887616`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:24:17,388::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:17,391::task::1185::TaskManager.Task::(prepare) Task=`6fb21ed7-f5ad-49c4-bf6e-783440887616`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967432704', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:17,394::task::595::TaskManager.Task::(_updateState) Task=`6fb21ed7-f5ad-49c4-bf6e-783440887616`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:24:17,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:24:17,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:24:17,420::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:24:17,424::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:24:17,426::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:24:17,428::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-15::DEBUG::2014-08-21 12:24:17,430::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:24:17,433::task::990::TaskManager.Task::(_decref) Task=`6fb21ed7-f5ad-49c4-bf6e-783440887616`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:24:17,509::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00241634 s, 206 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:17,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.567074 s, 1.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:19,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:24:27,512::task::595::TaskManager.Task::(_updateState) Task=`33fbfb2a-fb44-41f4-b252-29400d986904`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:24:27,513::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:24:27,514::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00241634', 'lastCheck': '10.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:24:27,514::task::1185::TaskManager.Task::(prepare) Task=`33fbfb2a-fb44-41f4-b252-29400d986904`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00241634', 'lastCheck': '10.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:24:27,514::task::595::TaskManager.Task::(_updateState) Task=`33fbfb2a-fb44-41f4-b252-29400d986904`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:24:27,514::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:24:27,515::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:24:27,515::task::990::TaskManager.Task::(_decref) Task=`33fbfb2a-fb44-41f4-b252-29400d986904`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:24:27,590::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-13::DEBUG::2014-08-21 12:24:27,625::task::595::TaskManager.Task::(_updateState) Task=`a2a427a8-c0c4-4137-973e-1928525d2d26`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:24:27,626::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:24:27,627::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:24:27,628::task::1185::TaskManager.Task::(prepare) Task=`a2a427a8-c0c4-4137-973e-1928525d2d26`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:24:27,629::task::595::TaskManager.Task::(_updateState) Task=`a2a427a8-c0c4-4137-973e-1928525d2d26`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:24:27,629::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:24:27,630::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:24:27,630::task::990::TaskManager.Task::(_decref) Task=`a2a427a8-c0c4-4137-973e-1928525d2d26`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:24:27,864::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [74e7a7e4]
>Thread-34::DEBUG::2014-08-21 12:24:28,008::task::595::TaskManager.Task::(_updateState) Task=`b1b623fa-c965-4f3e-a180-1b5fe2a16208`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:24:28,090::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:24:28,173::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a6fab1cb-cb09-401b-86a6-0720a4ea7d61`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:24:28,173::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:24:28,174::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:24:28,175::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a6fab1cb-cb09-401b-86a6-0720a4ea7d61`::Granted request
>Thread-34::DEBUG::2014-08-21 12:24:28,176::task::827::TaskManager.Task::(resourceAcquired) Task=`b1b623fa-c965-4f3e-a180-1b5fe2a16208`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:24:28,177::task::990::TaskManager.Task::(_decref) Task=`b1b623fa-c965-4f3e-a180-1b5fe2a16208`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:24:28,412::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 12:24:28,416::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:28,432::task::1185::TaskManager.Task::(prepare) Task=`b1b623fa-c965-4f3e-a180-1b5fe2a16208`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:28,447::task::595::TaskManager.Task::(_updateState) Task=`b1b623fa-c965-4f3e-a180-1b5fe2a16208`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:24:28,448::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:24:28,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:24:28,454::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:24:28,556::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:24:28,565::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:24:28,570::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-15::DEBUG::2014-08-21 12:24:28,580::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00355732 s, 140 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:24:28,584::task::990::TaskManager.Task::(_decref) Task=`b1b623fa-c965-4f3e-a180-1b5fe2a16208`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:24:28,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 8.907 s, 115 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:30,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:24:32,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.10255 s, 929 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:34,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:24:34,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.328282 s, 3.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:36,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:24:38,969::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-13::DEBUG::2014-08-21 12:24:38,971::task::595::TaskManager.Task::(_updateState) Task=`403e8bff-fa6c-4244-879a-8171c94568b8`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:24:38,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:24:38,973::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:24:38,973::task::1185::TaskManager.Task::(prepare) Task=`403e8bff-fa6c-4244-879a-8171c94568b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:24:38,974::task::595::TaskManager.Task::(_updateState) Task=`403e8bff-fa6c-4244-879a-8171c94568b8`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:24:39,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:24:39,045::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:24:39,056::task::990::TaskManager.Task::(_decref) Task=`403e8bff-fa6c-4244-879a-8171c94568b8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:24:39,563::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [323081ad]
>Thread-34::DEBUG::2014-08-21 12:24:39,589::task::595::TaskManager.Task::(_updateState) Task=`712e9c27-8ea2-4e8b-a6e3-9f76396c5e97`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:24:39,602::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:24:39,604::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3a2b3b47-f1c0-4813-9911-c42beced6c83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:24:39,605::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:24:39,636::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:24:39,637::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3a2b3b47-f1c0-4813-9911-c42beced6c83`::Granted request
>Thread-34::DEBUG::2014-08-21 12:24:39,639::task::827::TaskManager.Task::(resourceAcquired) Task=`712e9c27-8ea2-4e8b-a6e3-9f76396c5e97`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:24:39,684::task::990::TaskManager.Task::(_decref) Task=`712e9c27-8ea2-4e8b-a6e3-9f76396c5e97`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:24:39,824::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:24:39,928::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00138459 s, 360 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 12:24:39,970::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:39,973::task::1185::TaskManager.Task::(prepare) Task=`712e9c27-8ea2-4e8b-a6e3-9f76396c5e97`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967694848', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:39,978::task::595::TaskManager.Task::(_updateState) Task=`712e9c27-8ea2-4e8b-a6e3-9f76396c5e97`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:24:40,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:24:40,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:24:40,016::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:24:40,017::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:24:40,017::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:24:40,018::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:24:40,019::task::990::TaskManager.Task::(_decref) Task=`712e9c27-8ea2-4e8b-a6e3-9f76396c5e97`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:24:40,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.94903 s, 525 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:24:54,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:24:56,110::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-26::DEBUG::2014-08-21 12:24:56,144::task::595::TaskManager.Task::(_updateState) Task=`062cd1ec-b125-4013-8641-5f0fc42a063c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:24:56,144::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:24:56,145::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:24:56,145::task::1185::TaskManager.Task::(prepare) Task=`062cd1ec-b125-4013-8641-5f0fc42a063c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:24:56,146::task::595::TaskManager.Task::(_updateState) Task=`062cd1ec-b125-4013-8641-5f0fc42a063c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:24:56,146::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:24:56,146::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:24:56,147::task::990::TaskManager.Task::(_decref) Task=`062cd1ec-b125-4013-8641-5f0fc42a063c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:24:56,493::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64036280]
>Thread-34::DEBUG::2014-08-21 12:24:56,495::task::595::TaskManager.Task::(_updateState) Task=`758283ae-32bd-41c6-9425-f1acf72fa286`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:24:56,496::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:24:56,497::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0f214576-a0bd-4737-a9c4-ea8cce643b1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:24:56,497::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:24:56,498::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:24:56,498::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0f214576-a0bd-4737-a9c4-ea8cce643b1b`::Granted request
>Thread-34::DEBUG::2014-08-21 12:24:56,499::task::827::TaskManager.Task::(resourceAcquired) Task=`758283ae-32bd-41c6-9425-f1acf72fa286`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:24:56,499::task::990::TaskManager.Task::(_decref) Task=`758283ae-32bd-41c6-9425-f1acf72fa286`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:24:56,505::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:56,505::task::1185::TaskManager.Task::(prepare) Task=`758283ae-32bd-41c6-9425-f1acf72fa286`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:24:56,506::task::595::TaskManager.Task::(_updateState) Task=`758283ae-32bd-41c6-9425-f1acf72fa286`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:24:56,506::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:24:56,506::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:24:56,507::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:24:56,507::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:24:56,507::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:24:56,507::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:24:56,508::task::990::TaskManager.Task::(_decref) Task=`758283ae-32bd-41c6-9425-f1acf72fa286`::ref 0 aborting False
>Thread-13::DEBUG::2014-08-21 12:24:59,979::task::595::TaskManager.Task::(_updateState) Task=`8c6dc7ee-c5d5-40c0-b1e5-804a90823091`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:25:00,119::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:25:00,158::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138459', 'lastCheck': '20.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:25:00,159::task::1185::TaskManager.Task::(prepare) Task=`8c6dc7ee-c5d5-40c0-b1e5-804a90823091`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138459', 'lastCheck': '20.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:25:00,159::task::595::TaskManager.Task::(_updateState) Task=`8c6dc7ee-c5d5-40c0-b1e5-804a90823091`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:25:00,173::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:25:00,174::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:25:00,183::task::990::TaskManager.Task::(_decref) Task=`8c6dc7ee-c5d5-40c0-b1e5-804a90823091`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:25:00,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:25:01,261::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00577915 s, 86.2 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:25:01,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.10419 s, 927 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:25:03,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:25:03,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0683691 s, 15.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:25:11,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:25:13,829::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-26::DEBUG::2014-08-21 12:25:13,917::task::595::TaskManager.Task::(_updateState) Task=`c61a7e46-f81a-409c-9285-61682d4ef78c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:25:13,918::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:25:13,918::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:25:13,919::task::1185::TaskManager.Task::(prepare) Task=`c61a7e46-f81a-409c-9285-61682d4ef78c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:25:13,919::task::595::TaskManager.Task::(_updateState) Task=`c61a7e46-f81a-409c-9285-61682d4ef78c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:25:13,919::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:25:13,919::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:25:13,920::task::990::TaskManager.Task::(_decref) Task=`c61a7e46-f81a-409c-9285-61682d4ef78c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:25:13,999::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [748dc51c]
>Thread-34::DEBUG::2014-08-21 12:25:14,000::task::595::TaskManager.Task::(_updateState) Task=`4fb81914-8bc0-4c61-8298-98b2d2e1cf84`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:25:14,000::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:25:14,028::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d02a2dfa-9189-4ccf-8057-58fedbf661c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:25:14,030::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:25:14,034::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:25:14,036::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d02a2dfa-9189-4ccf-8057-58fedbf661c2`::Granted request
>Thread-34::DEBUG::2014-08-21 12:25:14,041::task::827::TaskManager.Task::(resourceAcquired) Task=`4fb81914-8bc0-4c61-8298-98b2d2e1cf84`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:25:14,080::task::990::TaskManager.Task::(_decref) Task=`4fb81914-8bc0-4c61-8298-98b2d2e1cf84`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:25:30,860::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:25:30,860::task::1185::TaskManager.Task::(prepare) Task=`4fb81914-8bc0-4c61-8298-98b2d2e1cf84`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:25:30,861::task::595::TaskManager.Task::(_updateState) Task=`4fb81914-8bc0-4c61-8298-98b2d2e1cf84`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:25:30,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:25:30,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:25:31,034::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:25:31,034::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:25:31,035::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:25:31,035::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:25:31,035::task::990::TaskManager.Task::(_decref) Task=`4fb81914-8bc0-4c61-8298-98b2d2e1cf84`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:25:31,231::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:25:31,383::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0470017 s, 10.6 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:25:52,976::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-26::DEBUG::2014-08-21 12:25:52,977::task::595::TaskManager.Task::(_updateState) Task=`aa882158-008a-4c39-ab8b-d7306fc45dbb`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:25:54,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:25:54,918::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:25:54,957::task::1185::TaskManager.Task::(prepare) Task=`aa882158-008a-4c39-ab8b-d7306fc45dbb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:25:54,959::task::595::TaskManager.Task::(_updateState) Task=`aa882158-008a-4c39-ab8b-d7306fc45dbb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:25:54,963::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:25:54,963::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:25:54,965::task::990::TaskManager.Task::(_decref) Task=`aa882158-008a-4c39-ab8b-d7306fc45dbb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:25:56,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 22.9075 s, 44.7 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:25:56,441::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-34::DEBUG::2014-08-21 12:25:56,442::task::595::TaskManager.Task::(_updateState) Task=`0a0fd866-ec7a-4ea6-a944-394f720e9bd6`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:25:56,443::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:25:56,443::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a24efa19-eeac-43a1-9333-90a87265e204`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:25:56,444::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:25:56,444::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:25:56,444::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a24efa19-eeac-43a1-9333-90a87265e204`::Granted request
>Thread-34::DEBUG::2014-08-21 12:25:56,445::task::827::TaskManager.Task::(resourceAcquired) Task=`0a0fd866-ec7a-4ea6-a944-394f720e9bd6`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:25:56,445::task::990::TaskManager.Task::(_decref) Task=`0a0fd866-ec7a-4ea6-a944-394f720e9bd6`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:25:56,451::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:25:56,452::task::1185::TaskManager.Task::(prepare) Task=`0a0fd866-ec7a-4ea6-a944-394f720e9bd6`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:25:56,452::task::595::TaskManager.Task::(_updateState) Task=`0a0fd866-ec7a-4ea6-a944-394f720e9bd6`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:25:56,452::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:25:56,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:25:56,453::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:25:56,453::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:25:56,454::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:25:56,454::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:25:56,454::task::990::TaskManager.Task::(_decref) Task=`0a0fd866-ec7a-4ea6-a944-394f720e9bd6`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:25:57,820::task::595::TaskManager.Task::(_updateState) Task=`2dcc7fde-d370-4695-af7f-780a3c76c981`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:25:57,821::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:25:57,821::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0470017', 'lastCheck': '4.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:25:57,822::task::1185::TaskManager.Task::(prepare) Task=`2dcc7fde-d370-4695-af7f-780a3c76c981`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0470017', 'lastCheck': '4.8', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:25:57,822::task::595::TaskManager.Task::(_updateState) Task=`2dcc7fde-d370-4695-af7f-780a3c76c981`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:25:57,822::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:25:57,823::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:25:57,823::task::990::TaskManager.Task::(_decref) Task=`2dcc7fde-d370-4695-af7f-780a3c76c981`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:25:59,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:26:08,323::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-13::DEBUG::2014-08-21 12:26:09,497::task::595::TaskManager.Task::(_updateState) Task=`e2922ea2-b4f3-4888-9065-946ce672d228`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:26:09,553::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:26:09,554::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:26:09,556::task::1185::TaskManager.Task::(prepare) Task=`e2922ea2-b4f3-4888-9065-946ce672d228`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:26:09,556::task::595::TaskManager.Task::(_updateState) Task=`e2922ea2-b4f3-4888-9065-946ce672d228`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:26:09,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:26:09,557::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:26:09,557::task::990::TaskManager.Task::(_decref) Task=`e2922ea2-b4f3-4888-9065-946ce672d228`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:26:10,379::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [49d834fe]
>Thread-34::DEBUG::2014-08-21 12:26:10,616::task::595::TaskManager.Task::(_updateState) Task=`cc02e35c-5774-426b-990c-80da1bfc9dda`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:26:10,617::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:26:10,618::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5cb05535-8d4a-43b3-9e23-e0bfa7c0e424`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:26:10,618::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:26:10,619::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:26:10,619::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`5cb05535-8d4a-43b3-9e23-e0bfa7c0e424`::Granted request
>Thread-34::DEBUG::2014-08-21 12:26:10,620::task::827::TaskManager.Task::(resourceAcquired) Task=`cc02e35c-5774-426b-990c-80da1bfc9dda`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:26:10,620::task::990::TaskManager.Task::(_decref) Task=`cc02e35c-5774-426b-990c-80da1bfc9dda`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:26:11,054::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 12:26:11,139::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:26:11,140::task::1185::TaskManager.Task::(prepare) Task=`cc02e35c-5774-426b-990c-80da1bfc9dda`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:26:11,147::task::595::TaskManager.Task::(_updateState) Task=`cc02e35c-5774-426b-990c-80da1bfc9dda`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:26:11,147::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:26:11,148::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:26:11,149::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:26:11,149::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:26:11,150::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:26:11,150::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:26:11,197::task::990::TaskManager.Task::(_decref) Task=`cc02e35c-5774-426b-990c-80da1bfc9dda`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:26:11,203::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00815295 s, 61.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:26:11,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 11.0358 s, 92.8 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:26:13,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:26:17,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.60104 s, 284 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:26:19,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:26:20,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.354327 s, 2.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:26:23,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:26:23,264::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-13::DEBUG::2014-08-21 12:26:24,270::task::595::TaskManager.Task::(_updateState) Task=`69580fc4-524f-4fea-827e-11a6f555ab32`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:26:24,271::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:26:24,272::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:26:24,273::task::1185::TaskManager.Task::(prepare) Task=`69580fc4-524f-4fea-827e-11a6f555ab32`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:26:24,285::task::595::TaskManager.Task::(_updateState) Task=`69580fc4-524f-4fea-827e-11a6f555ab32`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:26:24,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:26:24,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:26:24,287::task::990::TaskManager.Task::(_decref) Task=`69580fc4-524f-4fea-827e-11a6f555ab32`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:26:24,289::task::595::TaskManager.Task::(_updateState) Task=`18e22964-fb34-44a9-8538-7b701b5fa477`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:26:25,355::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:26:26,472::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00815295', 'lastCheck': '13.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:26:26,473::task::1185::TaskManager.Task::(prepare) Task=`18e22964-fb34-44a9-8538-7b701b5fa477`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00815295', 'lastCheck': '13.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:26:26,528::task::595::TaskManager.Task::(_updateState) Task=`18e22964-fb34-44a9-8538-7b701b5fa477`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:26:26,529::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:26:26,529::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:26:26,530::task::990::TaskManager.Task::(_decref) Task=`18e22964-fb34-44a9-8538-7b701b5fa477`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:26:29,481::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:26:29,876::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6a87401b]
>Thread-34::DEBUG::2014-08-21 12:26:29,959::task::595::TaskManager.Task::(_updateState) Task=`9e515039-82f2-421c-a9c1-f36e68733412`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:26:30,380::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:26:30,582::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aab8b0ed-3dbf-47c3-9269-b07d5c2f6e45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:26:30,583::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-15::DEBUG::2014-08-21 12:26:30,668::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000635426 s, 784 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:26:33,324::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:26:33,480::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aab8b0ed-3dbf-47c3-9269-b07d5c2f6e45`::Granted request
>Thread-34::DEBUG::2014-08-21 12:26:33,481::task::827::TaskManager.Task::(resourceAcquired) Task=`9e515039-82f2-421c-a9c1-f36e68733412`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:26:33,481::task::990::TaskManager.Task::(_decref) Task=`9e515039-82f2-421c-a9c1-f36e68733412`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:26:33,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:26:33,490::task::1185::TaskManager.Task::(prepare) Task=`9e515039-82f2-421c-a9c1-f36e68733412`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968415744', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:26:33,490::task::595::TaskManager.Task::(_updateState) Task=`9e515039-82f2-421c-a9c1-f36e68733412`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:26:33,490::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:26:33,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:26:33,493::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:26:33,493::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:26:33,494::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:26:33,494::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:26:33,494::task::990::TaskManager.Task::(_decref) Task=`9e515039-82f2-421c-a9c1-f36e68733412`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:26:34,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 9.51258 s, 108 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:26:36,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:26:36,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.176779 s, 5.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:26:38,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:26:40,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.02599 s, 998 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:26:42,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:26:43,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.68026 s, 1.5 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:26:43,696::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-26::DEBUG::2014-08-21 12:26:43,754::task::595::TaskManager.Task::(_updateState) Task=`0cb9d171-12e6-4eb5-84c2-de89dffdf09f`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:26:43,755::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 12:26:43,841::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::INFO::2014-08-21 12:26:44,205::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:26:44,206::task::1185::TaskManager.Task::(prepare) Task=`0cb9d171-12e6-4eb5-84c2-de89dffdf09f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:26:44,207::task::595::TaskManager.Task::(_updateState) Task=`0cb9d171-12e6-4eb5-84c2-de89dffdf09f`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:26:44,207::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:26:44,420::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:26:44,421::task::990::TaskManager.Task::(_decref) Task=`0cb9d171-12e6-4eb5-84c2-de89dffdf09f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:26:44,468::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0110236 s, 45.2 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:26:44,775::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1edaee16]
>Thread-34::DEBUG::2014-08-21 12:26:44,813::task::595::TaskManager.Task::(_updateState) Task=`f004f7da-5074-4c67-97b4-771f712bdc55`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:26:44,838::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:26:44,839::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e57991fb-5113-42d8-8ed0-01c698c9055f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:26:44,839::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:26:44,840::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:26:44,840::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`e57991fb-5113-42d8-8ed0-01c698c9055f`::Granted request
>Thread-34::DEBUG::2014-08-21 12:26:44,867::task::827::TaskManager.Task::(resourceAcquired) Task=`f004f7da-5074-4c67-97b4-771f712bdc55`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:26:44,868::task::990::TaskManager.Task::(_decref) Task=`f004f7da-5074-4c67-97b4-771f712bdc55`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:26:44,905::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:26:44,906::task::1185::TaskManager.Task::(prepare) Task=`f004f7da-5074-4c67-97b4-771f712bdc55`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968284672', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:26:44,906::task::595::TaskManager.Task::(_updateState) Task=`f004f7da-5074-4c67-97b4-771f712bdc55`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:26:44,906::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:26:44,907::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Dummy-33::DEBUG::2014-08-21 12:26:45,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:26:45,299::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:26:45,300::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:26:45,301::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:26:45,301::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:26:45,302::task::990::TaskManager.Task::(_decref) Task=`f004f7da-5074-4c67-97b4-771f712bdc55`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:26:46,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.05876 s, 967 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:26:48,385::task::595::TaskManager.Task::(_updateState) Task=`fcaa7eae-77a2-479e-897d-18f5f41a61b1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:26:48,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:26:48,386::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0110236', 'lastCheck': '3.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:26:48,387::task::1185::TaskManager.Task::(prepare) Task=`fcaa7eae-77a2-479e-897d-18f5f41a61b1`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0110236', 'lastCheck': '3.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:26:48,387::task::595::TaskManager.Task::(_updateState) Task=`fcaa7eae-77a2-479e-897d-18f5f41a61b1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:26:48,387::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:26:48,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:26:48,388::task::990::TaskManager.Task::(_decref) Task=`fcaa7eae-77a2-479e-897d-18f5f41a61b1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:26:49,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:26:50,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.325121 s, 3.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:26:52,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:26:52,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0995579 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:26:54,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:26:59,537::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-26::DEBUG::2014-08-21 12:26:59,553::task::595::TaskManager.Task::(_updateState) Task=`b63229d9-e150-44dd-ad4a-e95c9eef72ed`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:26:59,560::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:26:59,571::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:26:59,572::task::1185::TaskManager.Task::(prepare) Task=`b63229d9-e150-44dd-ad4a-e95c9eef72ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:26:59,576::task::595::TaskManager.Task::(_updateState) Task=`b63229d9-e150-44dd-ad4a-e95c9eef72ed`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:26:59,577::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:26:59,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:26:59,586::task::990::TaskManager.Task::(_decref) Task=`b63229d9-e150-44dd-ad4a-e95c9eef72ed`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:26:59,592::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:27:03,029::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000910824 s, 547 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:27:03,082::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [456d972f]
>Thread-34::DEBUG::2014-08-21 12:27:03,083::task::595::TaskManager.Task::(_updateState) Task=`7039f131-c54e-473a-b008-37e8d0fe5a92`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:27:03,083::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:27:03,084::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d342af04-6fff-422d-a70a-f59e84839cf6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:27:03,085::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:27:03,086::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:27:03,208::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`d342af04-6fff-422d-a70a-f59e84839cf6`::Granted request
>Thread-34::DEBUG::2014-08-21 12:27:03,797::task::827::TaskManager.Task::(resourceAcquired) Task=`7039f131-c54e-473a-b008-37e8d0fe5a92`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:27:03,839::task::990::TaskManager.Task::(_decref) Task=`7039f131-c54e-473a-b008-37e8d0fe5a92`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:27:04,204::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:04,205::task::1185::TaskManager.Task::(prepare) Task=`7039f131-c54e-473a-b008-37e8d0fe5a92`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:04,206::task::595::TaskManager.Task::(_updateState) Task=`7039f131-c54e-473a-b008-37e8d0fe5a92`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:27:04,207::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:27:04,207::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:27:04,219::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:27:04,222::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:27:04,223::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:27:04,224::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:27:04,225::task::990::TaskManager.Task::(_decref) Task=`7039f131-c54e-473a-b008-37e8d0fe5a92`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:05,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 10.8647 s, 94.2 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:27:06,136::task::595::TaskManager.Task::(_updateState) Task=`151bba06-714a-4c59-b6b0-ce4226b0bf48`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:27:06,137::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:27:06,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000910824', 'lastCheck': '2.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:27:06,137::task::1185::TaskManager.Task::(prepare) Task=`151bba06-714a-4c59-b6b0-ce4226b0bf48`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000910824', 'lastCheck': '2.4', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:27:06,138::task::595::TaskManager.Task::(_updateState) Task=`151bba06-714a-4c59-b6b0-ce4226b0bf48`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:27:06,138::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:27:06,138::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:27:06,138::task::990::TaskManager.Task::(_decref) Task=`151bba06-714a-4c59-b6b0-ce4226b0bf48`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:07,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:09,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.43275 s, 715 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:11,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:11,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0818856 s, 12.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:13,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:13,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.139094 s, 7.4 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:27:13,859::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:27:13,886::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000699559 s, 712 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:27:14,280::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-13::DEBUG::2014-08-21 12:27:14,281::task::595::TaskManager.Task::(_updateState) Task=`c1332e86-655b-4f27-978a-f3c6b6ac1e6b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:27:14,282::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:27:14,283::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:14,283::task::1185::TaskManager.Task::(prepare) Task=`c1332e86-655b-4f27-978a-f3c6b6ac1e6b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:14,284::task::595::TaskManager.Task::(_updateState) Task=`c1332e86-655b-4f27-978a-f3c6b6ac1e6b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:27:14,284::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:27:14,285::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:27:14,285::task::990::TaskManager.Task::(_decref) Task=`c1332e86-655b-4f27-978a-f3c6b6ac1e6b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:27:14,291::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4c4b6431]
>Thread-34::DEBUG::2014-08-21 12:27:14,292::task::595::TaskManager.Task::(_updateState) Task=`6d191483-de6f-42eb-993a-6b975c354fa3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:27:14,293::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:27:14,294::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`53aecd82-1c48-4005-a03a-51efd8520d6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:27:14,294::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:27:14,295::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:27:14,295::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`53aecd82-1c48-4005-a03a-51efd8520d6f`::Granted request
>Thread-34::DEBUG::2014-08-21 12:27:14,296::task::827::TaskManager.Task::(resourceAcquired) Task=`6d191483-de6f-42eb-993a-6b975c354fa3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:27:14,296::task::990::TaskManager.Task::(_decref) Task=`6d191483-de6f-42eb-993a-6b975c354fa3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:27:14,304::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:14,304::task::1185::TaskManager.Task::(prepare) Task=`6d191483-de6f-42eb-993a-6b975c354fa3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968022528', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:14,305::task::595::TaskManager.Task::(_updateState) Task=`6d191483-de6f-42eb-993a-6b975c354fa3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:27:14,305::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:27:14,306::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:27:14,306::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:27:14,307::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:27:14,308::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:27:14,308::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:27:14,309::task::990::TaskManager.Task::(_decref) Task=`6d191483-de6f-42eb-993a-6b975c354fa3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:15,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:16,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0814553 s, 12.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:18,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:18,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.163988 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:20,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:21,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.592188 s, 1.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:23,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:27:23,437::task::595::TaskManager.Task::(_updateState) Task=`11267789-e5c0-470c-a8ab-381ca995bca0`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:27:23,438::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:27:23,439::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699559', 'lastCheck': '9.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:27:23,439::task::1185::TaskManager.Task::(prepare) Task=`11267789-e5c0-470c-a8ab-381ca995bca0`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699559', 'lastCheck': '9.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:27:23,440::task::595::TaskManager.Task::(_updateState) Task=`11267789-e5c0-470c-a8ab-381ca995bca0`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:27:23,440::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:27:23,440::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:27:23,441::task::990::TaskManager.Task::(_decref) Task=`11267789-e5c0-470c-a8ab-381ca995bca0`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:23,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.398885 s, 2.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:27:23,913::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:27:23,946::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00112616 s, 442 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:27:24,329::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-13::DEBUG::2014-08-21 12:27:24,330::task::595::TaskManager.Task::(_updateState) Task=`4c74d04c-5f85-4449-a4f9-af7fc17328cf`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:27:24,331::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:27:24,331::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:24,332::task::1185::TaskManager.Task::(prepare) Task=`4c74d04c-5f85-4449-a4f9-af7fc17328cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:24,332::task::595::TaskManager.Task::(_updateState) Task=`4c74d04c-5f85-4449-a4f9-af7fc17328cf`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:27:24,332::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:27:24,333::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:27:24,333::task::990::TaskManager.Task::(_decref) Task=`4c74d04c-5f85-4449-a4f9-af7fc17328cf`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:27:24,375::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2dc76176]
>Thread-34::DEBUG::2014-08-21 12:27:24,383::task::595::TaskManager.Task::(_updateState) Task=`b99932e9-e814-4b0d-b50c-d3b6348fc23f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:27:24,383::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:27:24,384::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3d899ef4-2d01-440f-b416-38346be25e1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:27:24,384::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:27:24,385::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:27:24,385::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3d899ef4-2d01-440f-b416-38346be25e1a`::Granted request
>Thread-34::DEBUG::2014-08-21 12:27:24,386::task::827::TaskManager.Task::(resourceAcquired) Task=`b99932e9-e814-4b0d-b50c-d3b6348fc23f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:27:24,386::task::990::TaskManager.Task::(_decref) Task=`b99932e9-e814-4b0d-b50c-d3b6348fc23f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:27:24,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:24,392::task::1185::TaskManager.Task::(prepare) Task=`b99932e9-e814-4b0d-b50c-d3b6348fc23f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:24,392::task::595::TaskManager.Task::(_updateState) Task=`b99932e9-e814-4b0d-b50c-d3b6348fc23f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:27:24,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:27:24,393::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:27:24,394::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:27:24,394::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:27:24,394::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:27:24,395::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:27:24,395::task::990::TaskManager.Task::(_decref) Task=`b99932e9-e814-4b0d-b50c-d3b6348fc23f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:25,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:26,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.432959 s, 2.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:28,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:28,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0987171 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:30,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:32,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0809216 s, 12.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:27:34,003::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:27:34,038::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0018471 s, 270 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:27:34,445::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-13::DEBUG::2014-08-21 12:27:34,446::task::595::TaskManager.Task::(_updateState) Task=`184f31c7-6d04-4627-9833-f861b570170b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:27:34,447::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:27:34,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:34,447::task::1185::TaskManager.Task::(prepare) Task=`184f31c7-6d04-4627-9833-f861b570170b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:34,447::task::595::TaskManager.Task::(_updateState) Task=`184f31c7-6d04-4627-9833-f861b570170b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:27:34,448::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:27:34,448::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:27:34,448::task::990::TaskManager.Task::(_decref) Task=`184f31c7-6d04-4627-9833-f861b570170b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:27:34,454::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a891e9]
>Thread-34::DEBUG::2014-08-21 12:27:34,454::task::595::TaskManager.Task::(_updateState) Task=`550affc9-11c1-4e52-b3fb-296838489b32`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:27:34,454::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:27:34,455::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c6d26ed7-5bbd-4e0c-b96f-3dc58f69fe10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:27:34,455::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:27:34,456::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:27:34,456::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`c6d26ed7-5bbd-4e0c-b96f-3dc58f69fe10`::Granted request
>Thread-34::DEBUG::2014-08-21 12:27:34,457::task::827::TaskManager.Task::(resourceAcquired) Task=`550affc9-11c1-4e52-b3fb-296838489b32`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:27:34,457::task::990::TaskManager.Task::(_decref) Task=`550affc9-11c1-4e52-b3fb-296838489b32`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:27:34,465::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:34,465::task::1185::TaskManager.Task::(prepare) Task=`550affc9-11c1-4e52-b3fb-296838489b32`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:34,465::task::595::TaskManager.Task::(_updateState) Task=`550affc9-11c1-4e52-b3fb-296838489b32`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:27:34,465::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:27:34,466::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:27:34,466::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:27:34,466::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:27:34,466::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:27:34,467::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:27:34,467::task::990::TaskManager.Task::(_decref) Task=`550affc9-11c1-4e52-b3fb-296838489b32`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:34,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:34,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0649224 s, 15.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:36,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:37,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.847598 s, 1.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:27:38,596::task::595::TaskManager.Task::(_updateState) Task=`9fac6389-482e-4adf-88d0-e49730d9ffce`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:27:38,596::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:27:38,597::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018471', 'lastCheck': '4.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:27:38,601::task::1185::TaskManager.Task::(prepare) Task=`9fac6389-482e-4adf-88d0-e49730d9ffce`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018471', 'lastCheck': '4.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:27:38,602::task::595::TaskManager.Task::(_updateState) Task=`9fac6389-482e-4adf-88d0-e49730d9ffce`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:27:38,602::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:27:38,602::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:27:38,603::task::990::TaskManager.Task::(_decref) Task=`9fac6389-482e-4adf-88d0-e49730d9ffce`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:39,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:40,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.273961 s, 3.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:42,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:27:44,879::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-13::DEBUG::2014-08-21 12:27:44,949::task::595::TaskManager.Task::(_updateState) Task=`fcef2825-50e2-47d5-89d9-8ba040a28a15`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:27:45,121::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:27:45,207::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:45,209::task::1185::TaskManager.Task::(prepare) Task=`fcef2825-50e2-47d5-89d9-8ba040a28a15`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:45,210::task::595::TaskManager.Task::(_updateState) Task=`fcef2825-50e2-47d5-89d9-8ba040a28a15`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:27:45,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:27:45,266::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:27:45,266::task::990::TaskManager.Task::(_decref) Task=`fcef2825-50e2-47d5-89d9-8ba040a28a15`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:27:45,371::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:27:45,421::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [394c9da9]
>Thread-34::DEBUG::2014-08-21 12:27:45,443::task::595::TaskManager.Task::(_updateState) Task=`16b616a4-1794-4222-a5c1-60cda9f2375f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:27:45,446::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:27:45,456::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9bab2c87-686f-45fa-8166-8311971fc4d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:27:45,460::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:27:45,464::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:27:45,467::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9bab2c87-686f-45fa-8166-8311971fc4d7`::Granted request
>Thread-34::DEBUG::2014-08-21 12:27:45,472::task::827::TaskManager.Task::(resourceAcquired) Task=`16b616a4-1794-4222-a5c1-60cda9f2375f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:27:45,473::task::990::TaskManager.Task::(_decref) Task=`16b616a4-1794-4222-a5c1-60cda9f2375f`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:27:45,528::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00966962 s, 51.5 kB/s\n'; <rc> = 0
>Thread-34::INFO::2014-08-21 12:27:45,548::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:45,548::task::1185::TaskManager.Task::(prepare) Task=`16b616a4-1794-4222-a5c1-60cda9f2375f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:45,549::task::595::TaskManager.Task::(_updateState) Task=`16b616a4-1794-4222-a5c1-60cda9f2375f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:27:45,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:27:45,595::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:27:45,605::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:27:45,606::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:27:45,606::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:27:45,606::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:27:45,607::task::990::TaskManager.Task::(_decref) Task=`16b616a4-1794-4222-a5c1-60cda9f2375f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:46,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 3.37303 s, 304 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:48,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:48,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474427 s, 21.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:50,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:51,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0989612 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:53,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:53,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.433822 s, 2.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:27:54,525::task::595::TaskManager.Task::(_updateState) Task=`9891ebd0-e677-4278-997c-a5b11a48bd67`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:27:54,526::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:27:54,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00966962', 'lastCheck': '8.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:27:54,539::task::1185::TaskManager.Task::(prepare) Task=`9891ebd0-e677-4278-997c-a5b11a48bd67`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00966962', 'lastCheck': '8.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:27:54,540::task::595::TaskManager.Task::(_updateState) Task=`9891ebd0-e677-4278-997c-a5b11a48bd67`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:27:54,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:27:54,540::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:27:54,540::task::990::TaskManager.Task::(_decref) Task=`9891ebd0-e677-4278-997c-a5b11a48bd67`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:55,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:27:55,801::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-13::DEBUG::2014-08-21 12:27:55,806::task::595::TaskManager.Task::(_updateState) Task=`ada099e5-a850-41fe-a8c8-30238311ac35`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:27:55,807::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:27:55,808::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:55,808::task::1185::TaskManager.Task::(prepare) Task=`ada099e5-a850-41fe-a8c8-30238311ac35`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:27:55,809::task::595::TaskManager.Task::(_updateState) Task=`ada099e5-a850-41fe-a8c8-30238311ac35`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:27:55,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:27:55,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:27:55,810::task::990::TaskManager.Task::(_decref) Task=`ada099e5-a850-41fe-a8c8-30238311ac35`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:27:55,817::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ea2d21e]
>Thread-34::DEBUG::2014-08-21 12:27:55,818::task::595::TaskManager.Task::(_updateState) Task=`42c86655-e71f-49a5-b9a9-f93f2d6ea3c3`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:27:55,819::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:27:55,821::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f5ae861c-d450-4042-8c66-7507f9c631d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:27:55,822::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:27:55,823::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:27:55,824::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`f5ae861c-d450-4042-8c66-7507f9c631d8`::Granted request
>Thread-34::DEBUG::2014-08-21 12:27:55,826::task::827::TaskManager.Task::(resourceAcquired) Task=`42c86655-e71f-49a5-b9a9-f93f2d6ea3c3`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:27:55,837::task::990::TaskManager.Task::(_decref) Task=`42c86655-e71f-49a5-b9a9-f93f2d6ea3c3`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:27:55,898::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:55,899::task::1185::TaskManager.Task::(prepare) Task=`42c86655-e71f-49a5-b9a9-f93f2d6ea3c3`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967956992', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:27:55,900::task::595::TaskManager.Task::(_updateState) Task=`42c86655-e71f-49a5-b9a9-f93f2d6ea3c3`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:27:55,900::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:27:55,909::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:27:55,913::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:27:55,916::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:27:55,919::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:27:55,921::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:27:55,933::task::990::TaskManager.Task::(_decref) Task=`42c86655-e71f-49a5-b9a9-f93f2d6ea3c3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:27:56,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.182408 s, 5.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:27:56,074::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:27:56,100::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00301204 s, 165 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:27:58,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:27:58,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.163143 s, 6.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:00,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:00,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0509442 s, 20.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:02,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:02,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0568373 s, 18.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:04,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:05,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.05563 s, 970 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:28:05,957::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-13::DEBUG::2014-08-21 12:28:05,958::task::595::TaskManager.Task::(_updateState) Task=`eae38b3b-d4a9-4bc3-b7b8-6f216f9cd1d3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:28:05,959::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:28:05,960::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:05,960::task::1185::TaskManager.Task::(prepare) Task=`eae38b3b-d4a9-4bc3-b7b8-6f216f9cd1d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:05,960::task::595::TaskManager.Task::(_updateState) Task=`eae38b3b-d4a9-4bc3-b7b8-6f216f9cd1d3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:28:05,961::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:28:05,961::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:28:05,961::task::990::TaskManager.Task::(_decref) Task=`eae38b3b-d4a9-4bc3-b7b8-6f216f9cd1d3`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:28:05,966::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4bfe6978]
>Thread-34::DEBUG::2014-08-21 12:28:05,966::task::595::TaskManager.Task::(_updateState) Task=`ec34a3b3-5e12-49e2-a27a-39771edb4ee9`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:28:05,967::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:28:05,968::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aaf500f9-2f56-4b8c-ac5e-611c767ba29e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:28:05,968::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:28:05,968::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:28:05,968::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`aaf500f9-2f56-4b8c-ac5e-611c767ba29e`::Granted request
>Thread-34::DEBUG::2014-08-21 12:28:05,969::task::827::TaskManager.Task::(resourceAcquired) Task=`ec34a3b3-5e12-49e2-a27a-39771edb4ee9`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:28:05,969::task::990::TaskManager.Task::(_decref) Task=`ec34a3b3-5e12-49e2-a27a-39771edb4ee9`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:28:05,973::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:05,974::task::1185::TaskManager.Task::(prepare) Task=`ec34a3b3-5e12-49e2-a27a-39771edb4ee9`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:05,974::task::595::TaskManager.Task::(_updateState) Task=`ec34a3b3-5e12-49e2-a27a-39771edb4ee9`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:28:05,974::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:28:05,974::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:28:05,975::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:28:05,975::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:28:05,975::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:28:05,975::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:28:05,976::task::990::TaskManager.Task::(_decref) Task=`ec34a3b3-5e12-49e2-a27a-39771edb4ee9`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:28:06,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:28:06,184::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000641825 s, 776 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:07,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:08,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0615231 s, 16.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:28:09,689::task::595::TaskManager.Task::(_updateState) Task=`493f8e57-5a4f-40e7-a140-12b7e4d915fa`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:28:09,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:28:09,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641825', 'lastCheck': '3.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:28:09,692::task::1185::TaskManager.Task::(prepare) Task=`493f8e57-5a4f-40e7-a140-12b7e4d915fa`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641825', 'lastCheck': '3.5', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:28:09,692::task::595::TaskManager.Task::(_updateState) Task=`493f8e57-5a4f-40e7-a140-12b7e4d915fa`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:28:09,692::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:28:09,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:28:09,693::task::990::TaskManager.Task::(_decref) Task=`493f8e57-5a4f-40e7-a140-12b7e4d915fa`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:28:10,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:11,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.46033 s, 701 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:13,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:13,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0658322 s, 15.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:15,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:28:16,002::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-13::DEBUG::2014-08-21 12:28:16,005::task::595::TaskManager.Task::(_updateState) Task=`60e43beb-cb14-4875-a4da-d375f70da2b4`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:28:16,008::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:28:16,013::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:16,014::task::1185::TaskManager.Task::(prepare) Task=`60e43beb-cb14-4875-a4da-d375f70da2b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:16,016::task::595::TaskManager.Task::(_updateState) Task=`60e43beb-cb14-4875-a4da-d375f70da2b4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:28:16,021::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:28:16,091::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:28:16,093::task::990::TaskManager.Task::(_decref) Task=`60e43beb-cb14-4875-a4da-d375f70da2b4`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:28:16,106::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1ccece45]
>Thread-34::DEBUG::2014-08-21 12:28:16,110::task::595::TaskManager.Task::(_updateState) Task=`c6d56be1-df67-4e61-8cc0-87fe431bccdc`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:28:16,112::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:28:16,116::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a3487d47-d6f7-4a8d-9be6-ccee98fbe213`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:28:16,117::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:28:16,119::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:28:16,121::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`a3487d47-d6f7-4a8d-9be6-ccee98fbe213`::Granted request
>Thread-34::DEBUG::2014-08-21 12:28:16,123::task::827::TaskManager.Task::(resourceAcquired) Task=`c6d56be1-df67-4e61-8cc0-87fe431bccdc`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:28:16,125::task::990::TaskManager.Task::(_decref) Task=`c6d56be1-df67-4e61-8cc0-87fe431bccdc`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:28:16,152::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:16,153::task::1185::TaskManager.Task::(prepare) Task=`c6d56be1-df67-4e61-8cc0-87fe431bccdc`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:16,155::task::595::TaskManager.Task::(_updateState) Task=`c6d56be1-df67-4e61-8cc0-87fe431bccdc`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:28:16,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:28:16,157::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:28:16,159::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:28:16,161::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:28:16,162::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:28:16,163::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:28:16,165::task::990::TaskManager.Task::(_decref) Task=`c6d56be1-df67-4e61-8cc0-87fe431bccdc`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:28:16,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0867977 s, 11.8 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:28:16,328::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:28:16,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000444411 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:18,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:19,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.961334 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:21,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:21,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.11881 s, 8.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:23,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:28:25,466::task::595::TaskManager.Task::(_updateState) Task=`a7a69963-e218-4646-87c0-2525b37f71d3`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:28:25,478::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:28:25,479::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444411', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:28:25,479::task::1185::TaskManager.Task::(prepare) Task=`a7a69963-e218-4646-87c0-2525b37f71d3`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444411', 'lastCheck': '9.1', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:28:25,480::task::595::TaskManager.Task::(_updateState) Task=`a7a69963-e218-4646-87c0-2525b37f71d3`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:28:25,480::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:28:25,480::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:28:25,481::task::990::TaskManager.Task::(_decref) Task=`a7a69963-e218-4646-87c0-2525b37f71d3`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:28:26,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.40348 s, 730 kB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:28:26,210::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [8cf019c]
>Thread-13::DEBUG::2014-08-21 12:28:26,211::task::595::TaskManager.Task::(_updateState) Task=`f62df9a7-6a0b-4381-b993-9e54bb58bc51`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:28:26,212::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:28:26,212::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:26,213::task::1185::TaskManager.Task::(prepare) Task=`f62df9a7-6a0b-4381-b993-9e54bb58bc51`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:26,213::task::595::TaskManager.Task::(_updateState) Task=`f62df9a7-6a0b-4381-b993-9e54bb58bc51`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:28:26,213::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:28:26,214::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:28:26,215::task::990::TaskManager.Task::(_decref) Task=`f62df9a7-6a0b-4381-b993-9e54bb58bc51`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:28:26,230::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [8cf019c]
>Thread-34::DEBUG::2014-08-21 12:28:26,231::task::595::TaskManager.Task::(_updateState) Task=`1c1f33c8-3af1-44f7-be2e-1a9269749652`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:28:26,232::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:28:26,233::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`46ed649f-aa71-4853-8855-3187699cbcf1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:28:26,233::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:28:26,234::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:28:26,234::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`46ed649f-aa71-4853-8855-3187699cbcf1`::Granted request
>Thread-34::DEBUG::2014-08-21 12:28:26,235::task::827::TaskManager.Task::(resourceAcquired) Task=`1c1f33c8-3af1-44f7-be2e-1a9269749652`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:28:26,236::task::990::TaskManager.Task::(_decref) Task=`1c1f33c8-3af1-44f7-be2e-1a9269749652`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:28:26,244::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:26,245::task::1185::TaskManager.Task::(prepare) Task=`1c1f33c8-3af1-44f7-be2e-1a9269749652`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:26,245::task::595::TaskManager.Task::(_updateState) Task=`1c1f33c8-3af1-44f7-be2e-1a9269749652`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:28:26,246::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:28:26,246::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:28:26,246::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:28:26,247::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:28:26,248::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:28:26,248::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:28:26,249::task::990::TaskManager.Task::(_decref) Task=`1c1f33c8-3af1-44f7-be2e-1a9269749652`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:28:26,366::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:28:26,421::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b
>Thread-15::DEBUG::2014-08-21 12:28:26,452::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-15::DEBUG::2014-08-21 12:28:26,503::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=TEST_SD_142', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=TEST_DC_142', 'POOL_DOMAINS=664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=36', 'POOL_UUID=80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_rhev_stress/sd_142', 'ROLE=Master', 'SDUUID=664aab68-c780-4f9b-9553-a35e801fdb8b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c94f84aeb77db286b7224950fc6337b14fa117e5']
>Thread-15::DEBUG::2014-08-21 12:28:26,517::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-15::INFO::2014-08-21 12:28:26,518::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_imageNS already registered
>Thread-15::INFO::2014-08-21 12:28:26,518::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 664aab68-c780-4f9b-9553-a35e801fdb8b_volumeNS already registered
>Thread-15::DEBUG::2014-08-21 12:28:26,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:28:26,588::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000469314 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:28,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:31,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.65161 s, 386 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:33,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:33,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.185495 s, 5.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:35,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:28:36,359::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-13::DEBUG::2014-08-21 12:28:36,388::task::595::TaskManager.Task::(_updateState) Task=`550ade25-a5eb-4b8b-bfc3-47f5eaa56cd5`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:28:36,389::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:28:36,465::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:36,466::task::1185::TaskManager.Task::(prepare) Task=`550ade25-a5eb-4b8b-bfc3-47f5eaa56cd5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:36,466::task::595::TaskManager.Task::(_updateState) Task=`550ade25-a5eb-4b8b-bfc3-47f5eaa56cd5`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:28:36,467::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:28:36,467::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:28:36,473::task::990::TaskManager.Task::(_decref) Task=`550ade25-a5eb-4b8b-bfc3-47f5eaa56cd5`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:28:36,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.648431 s, 1.6 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:28:36,950::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-34::DEBUG::2014-08-21 12:28:36,952::task::595::TaskManager.Task::(_updateState) Task=`9f6bee4f-5dc4-4953-9b52-45f2ef64ac1f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:28:36,952::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:28:36,953::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ead6d870-5f6b-4a24-b455-50d7ae664249`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:28:36,953::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:28:36,960::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:28:36,961::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`ead6d870-5f6b-4a24-b455-50d7ae664249`::Granted request
>Thread-34::DEBUG::2014-08-21 12:28:36,962::task::827::TaskManager.Task::(resourceAcquired) Task=`9f6bee4f-5dc4-4953-9b52-45f2ef64ac1f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:28:36,963::task::990::TaskManager.Task::(_decref) Task=`9f6bee4f-5dc4-4953-9b52-45f2ef64ac1f`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:28:37,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:37,015::task::1185::TaskManager.Task::(prepare) Task=`9f6bee4f-5dc4-4953-9b52-45f2ef64ac1f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:37,015::task::595::TaskManager.Task::(_updateState) Task=`9f6bee4f-5dc4-4953-9b52-45f2ef64ac1f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:28:37,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:28:37,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:28:37,016::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:28:37,016::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:28:37,017::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:28:37,017::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:28:37,018::task::990::TaskManager.Task::(_decref) Task=`9f6bee4f-5dc4-4953-9b52-45f2ef64ac1f`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:28:37,055::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:28:37,097::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00385744 s, 129 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:38,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:38,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0804706 s, 12.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:40,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:41,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0922052 s, 11.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:43,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:28:43,319::task::595::TaskManager.Task::(_updateState) Task=`3f76343e-ce95-412b-ba53-a5fb9108cb90`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:28:43,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-08-21 12:28:43,320::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00385744', 'lastCheck': '6.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:28:43,320::task::1185::TaskManager.Task::(prepare) Task=`3f76343e-ce95-412b-ba53-a5fb9108cb90`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00385744', 'lastCheck': '6.2', 'valid': True}}
>Thread-13::DEBUG::2014-08-21 12:28:43,320::task::595::TaskManager.Task::(_updateState) Task=`3f76343e-ce95-412b-ba53-a5fb9108cb90`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:28:43,320::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:28:43,321::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:28:43,321::task::990::TaskManager.Task::(_decref) Task=`3f76343e-ce95-412b-ba53-a5fb9108cb90`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:28:43,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897647 s, 11.4 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:45,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:45,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0578821 s, 17.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:28:47,108::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-13::DEBUG::2014-08-21 12:28:47,109::task::595::TaskManager.Task::(_updateState) Task=`2c8133e9-50d0-4f4f-bd29-69ca90d3ef52`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:28:47,109::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:28:47,110::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:47,110::task::1185::TaskManager.Task::(prepare) Task=`2c8133e9-50d0-4f4f-bd29-69ca90d3ef52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:47,111::task::595::TaskManager.Task::(_updateState) Task=`2c8133e9-50d0-4f4f-bd29-69ca90d3ef52`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:28:47,111::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:28:47,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:28:47,112::task::990::TaskManager.Task::(_decref) Task=`2c8133e9-50d0-4f4f-bd29-69ca90d3ef52`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:28:47,116::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 12:28:47,117::task::595::TaskManager.Task::(_updateState) Task=`3b2214f4-c05d-451d-a36c-6ecf16db347e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:28:47,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:28:47,118::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`470bcecd-761f-4cc8-8477-db786beb218e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:28:47,118::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:28:47,119::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:28:47,119::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`470bcecd-761f-4cc8-8477-db786beb218e`::Granted request
>Thread-34::DEBUG::2014-08-21 12:28:47,120::task::827::TaskManager.Task::(resourceAcquired) Task=`3b2214f4-c05d-451d-a36c-6ecf16db347e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:28:47,120::task::990::TaskManager.Task::(_decref) Task=`3b2214f4-c05d-451d-a36c-6ecf16db347e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:28:47,127::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:47,127::task::1185::TaskManager.Task::(prepare) Task=`3b2214f4-c05d-451d-a36c-6ecf16db347e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:28:47,128::task::595::TaskManager.Task::(_updateState) Task=`3b2214f4-c05d-451d-a36c-6ecf16db347e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:28:47,128::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:28:47,128::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:28:47,129::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:28:47,129::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:28:47,129::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:28:47,129::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:28:47,130::task::990::TaskManager.Task::(_decref) Task=`3b2214f4-c05d-451d-a36c-6ecf16db347e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:28:47,148::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:28:47,167::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000581234 s, 857 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:47,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:47,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104653 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:49,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:50,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.635701 s, 1.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:52,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:52,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105698 s, 9.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:54,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:28:55,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0864021 s, 11.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:28:57,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-13::DEBUG::2014-08-21 12:28:57,339::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-13::DEBUG::2014-08-21 12:28:57,340::task::595::TaskManager.Task::(_updateState) Task=`4c9b95c6-9bfb-482a-a15d-9cddc898f679`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:28:57,341::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:28:57,341::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:57,342::task::1185::TaskManager.Task::(prepare) Task=`4c9b95c6-9bfb-482a-a15d-9cddc898f679`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:28:57,342::task::595::TaskManager.Task::(_updateState) Task=`4c9b95c6-9bfb-482a-a15d-9cddc898f679`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:28:57,342::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:28:57,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:28:57,343::task::990::TaskManager.Task::(_decref) Task=`4c9b95c6-9bfb-482a-a15d-9cddc898f679`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:29:10,838::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 12:29:10,840::task::595::TaskManager.Task::(_updateState) Task=`8124d74f-4b32-4c03-a03f-bae661233703`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:29:10,841::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:29:10,843::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`325cbef8-8db9-4be8-b5da-4d747d67ab57`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:29:10,843::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:29:10,864::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:29:10,912::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`325cbef8-8db9-4be8-b5da-4d747d67ab57`::Granted request
>Thread-34::DEBUG::2014-08-21 12:29:10,984::task::827::TaskManager.Task::(resourceAcquired) Task=`8124d74f-4b32-4c03-a03f-bae661233703`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-26::DEBUG::2014-08-21 12:29:10,985::task::595::TaskManager.Task::(_updateState) Task=`036c7ed2-3866-4ebe-ad79-06ccdc5800da`::moving from state init -> state preparing
>Thread-34::DEBUG::2014-08-21 12:29:10,990::task::990::TaskManager.Task::(_decref) Task=`8124d74f-4b32-4c03-a03f-bae661233703`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:29:11,026::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::INFO::2014-08-21 12:29:11,113::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:29:11,149::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581234', 'lastCheck': '24.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:29:11,176::task::1185::TaskManager.Task::(prepare) Task=`036c7ed2-3866-4ebe-ad79-06ccdc5800da`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581234', 'lastCheck': '24.0', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:29:11,197::task::595::TaskManager.Task::(_updateState) Task=`036c7ed2-3866-4ebe-ad79-06ccdc5800da`::moving from state preparing -> state finished
>Thread-15::DEBUG::2014-08-21 12:29:11,207::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000440279 s, 1.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:29:11,217::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:29:11,237::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:29:11,260::task::990::TaskManager.Task::(_decref) Task=`036c7ed2-3866-4ebe-ad79-06ccdc5800da`::ref 0 aborting False
>Thread-34::INFO::2014-08-21 12:29:11,274::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:11,279::task::1185::TaskManager.Task::(prepare) Task=`8124d74f-4b32-4c03-a03f-bae661233703`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967760384', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:11,284::task::595::TaskManager.Task::(_updateState) Task=`8124d74f-4b32-4c03-a03f-bae661233703`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:29:11,290::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:29:11,298::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:29:11,306::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:29:11,313::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:29:11,317::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:29:11,320::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:29:11,326::task::990::TaskManager.Task::(_decref) Task=`8124d74f-4b32-4c03-a03f-bae661233703`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:29:11,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 14.3276 s, 71.5 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:13,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:18,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0729915 s, 14.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:20,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:20,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0496734 s, 20.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:29:21,294::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:29:21,309::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000575181 s, 866 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:29:21,385::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-26::DEBUG::2014-08-21 12:29:21,390::task::595::TaskManager.Task::(_updateState) Task=`4455cf67-f3e3-476b-a396-9efb62107a38`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:29:21,391::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:29:21,393::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:29:21,394::task::1185::TaskManager.Task::(prepare) Task=`4455cf67-f3e3-476b-a396-9efb62107a38`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:29:21,395::task::595::TaskManager.Task::(_updateState) Task=`4455cf67-f3e3-476b-a396-9efb62107a38`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:29:21,396::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:29:21,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:29:21,399::task::990::TaskManager.Task::(_decref) Task=`4455cf67-f3e3-476b-a396-9efb62107a38`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:29:21,408::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6fbf576d]
>Thread-34::DEBUG::2014-08-21 12:29:21,411::task::595::TaskManager.Task::(_updateState) Task=`252add9d-f1ec-49c7-ba2d-59892624d910`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:29:21,412::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:29:21,415::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7c851a7f-4877-42b8-a427-73c2a16c1e66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:29:21,416::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:29:21,418::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:29:21,419::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7c851a7f-4877-42b8-a427-73c2a16c1e66`::Granted request
>Thread-34::DEBUG::2014-08-21 12:29:21,421::task::827::TaskManager.Task::(resourceAcquired) Task=`252add9d-f1ec-49c7-ba2d-59892624d910`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:29:21,422::task::990::TaskManager.Task::(_decref) Task=`252add9d-f1ec-49c7-ba2d-59892624d910`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:29:21,444::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:21,446::task::1185::TaskManager.Task::(prepare) Task=`252add9d-f1ec-49c7-ba2d-59892624d910`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967563776', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:21,447::task::595::TaskManager.Task::(_updateState) Task=`252add9d-f1ec-49c7-ba2d-59892624d910`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:29:21,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:29:21,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:29:21,451::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:29:21,453::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:29:21,453::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:29:21,454::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:29:21,455::task::990::TaskManager.Task::(_decref) Task=`252add9d-f1ec-49c7-ba2d-59892624d910`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:29:22,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:22,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0667301 s, 15.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:24,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:24,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.135144 s, 7.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:26,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:27,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.800219 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:29,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:29,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102604 s, 10.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:29:30,199::task::595::TaskManager.Task::(_updateState) Task=`3a8851a2-e6ef-4bed-98a7-6496de5f12aa`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:29:30,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:29:30,255::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575181', 'lastCheck': '8.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:29:30,255::task::1185::TaskManager.Task::(prepare) Task=`3a8851a2-e6ef-4bed-98a7-6496de5f12aa`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575181', 'lastCheck': '8.9', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:29:30,255::task::595::TaskManager.Task::(_updateState) Task=`3a8851a2-e6ef-4bed-98a7-6496de5f12aa`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:29:30,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:29:30,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:29:30,256::task::990::TaskManager.Task::(_decref) Task=`3a8851a2-e6ef-4bed-98a7-6496de5f12aa`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:29:31,330::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:29:31,346::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000543291 s, 917 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:29:31,481::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-26::DEBUG::2014-08-21 12:29:31,483::task::595::TaskManager.Task::(_updateState) Task=`d61959b2-cdfa-46d1-a562-be62a12d8896`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:29:31,483::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:29:31,484::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:29:31,485::task::1185::TaskManager.Task::(prepare) Task=`d61959b2-cdfa-46d1-a562-be62a12d8896`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:29:31,485::task::595::TaskManager.Task::(_updateState) Task=`d61959b2-cdfa-46d1-a562-be62a12d8896`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:29:31,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:29:31,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:29:31,486::task::990::TaskManager.Task::(_decref) Task=`d61959b2-cdfa-46d1-a562-be62a12d8896`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:29:31,573::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [63935a35]
>Thread-34::DEBUG::2014-08-21 12:29:31,610::task::595::TaskManager.Task::(_updateState) Task=`e485f25b-34c1-4c4a-b72a-2973e2f4206d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:29:31,636::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:29:31,638::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`896677f0-9b2d-402c-8f97-b08261a22eec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:29:31,639::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:29:31,640::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:29:31,640::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`896677f0-9b2d-402c-8f97-b08261a22eec`::Granted request
>Thread-34::DEBUG::2014-08-21 12:29:31,642::task::827::TaskManager.Task::(resourceAcquired) Task=`e485f25b-34c1-4c4a-b72a-2973e2f4206d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:29:31,643::task::990::TaskManager.Task::(_decref) Task=`e485f25b-34c1-4c4a-b72a-2973e2f4206d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:29:31,922::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:31,924::task::1185::TaskManager.Task::(prepare) Task=`e485f25b-34c1-4c4a-b72a-2973e2f4206d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:31,924::task::595::TaskManager.Task::(_updateState) Task=`e485f25b-34c1-4c4a-b72a-2973e2f4206d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:29:31,925::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:29:31,926::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:29:31,956::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:29:31,959::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:29:31,960::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:29:31,960::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:29:31,961::task::990::TaskManager.Task::(_decref) Task=`e485f25b-34c1-4c4a-b72a-2973e2f4206d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:29:31,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:32,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0768019 s, 13.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:34,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:34,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0871993 s, 11.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:36,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:37,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.539702 s, 1.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:39,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:39,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0620425 s, 16.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:41,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:29:41,898::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:29:43,507::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-26::DEBUG::2014-08-21 12:29:43,513::task::595::TaskManager.Task::(_updateState) Task=`f0784a11-7d24-412b-a004-29893309910c`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:29:43,514::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:29:43,516::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:29:43,521::task::1185::TaskManager.Task::(prepare) Task=`f0784a11-7d24-412b-a004-29893309910c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:29:43,522::task::595::TaskManager.Task::(_updateState) Task=`f0784a11-7d24-412b-a004-29893309910c`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:29:43,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:29:43,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:29:43,598::task::990::TaskManager.Task::(_decref) Task=`f0784a11-7d24-412b-a004-29893309910c`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:29:43,801::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3f91af04]
>Thread-34::DEBUG::2014-08-21 12:29:43,811::task::595::TaskManager.Task::(_updateState) Task=`449ec569-6d93-4c4b-8519-a14024f33eed`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:29:43,820::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-15::DEBUG::2014-08-21 12:29:43,821::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.040475 s, 12.3 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:29:43,841::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b7b97e53-79c4-4deb-ace7-d42b21725590`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:29:43,844::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:29:43,875::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:29:43,883::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b7b97e53-79c4-4deb-ace7-d42b21725590`::Granted request
>Thread-34::DEBUG::2014-08-21 12:29:43,914::task::827::TaskManager.Task::(resourceAcquired) Task=`449ec569-6d93-4c4b-8519-a14024f33eed`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:29:43,914::task::990::TaskManager.Task::(_decref) Task=`449ec569-6d93-4c4b-8519-a14024f33eed`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:29:44,004::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:44,007::task::1185::TaskManager.Task::(prepare) Task=`449ec569-6d93-4c4b-8519-a14024f33eed`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:44,009::task::595::TaskManager.Task::(_updateState) Task=`449ec569-6d93-4c4b-8519-a14024f33eed`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:29:44,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:29:44,012::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:29:44,015::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:29:44,017::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:29:44,019::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:29:44,021::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:29:44,023::task::990::TaskManager.Task::(_decref) Task=`449ec569-6d93-4c4b-8519-a14024f33eed`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:29:44,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.56332 s, 399 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:46,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:29:46,495::task::595::TaskManager.Task::(_updateState) Task=`f28e0f96-f1eb-400d-aab3-e0153f3084d9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:29:46,497::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:29:46,499::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.040475', 'lastCheck': '2.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:29:46,501::task::1185::TaskManager.Task::(prepare) Task=`f28e0f96-f1eb-400d-aab3-e0153f3084d9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.040475', 'lastCheck': '2.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:29:46,502::task::595::TaskManager.Task::(_updateState) Task=`f28e0f96-f1eb-400d-aab3-e0153f3084d9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:29:46,515::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:29:46,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:29:46,519::task::990::TaskManager.Task::(_decref) Task=`f28e0f96-f1eb-400d-aab3-e0153f3084d9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:29:46,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0563885 s, 18.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:48,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:50,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.37898 s, 743 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:52,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:52,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0613727 s, 16.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:29:54,005::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:29:54,111::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-26::DEBUG::2014-08-21 12:29:54,113::task::595::TaskManager.Task::(_updateState) Task=`002bfaac-e9a4-4c9c-ac18-59ee398cecb2`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:29:54,113::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:29:54,114::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:29:54,115::task::1185::TaskManager.Task::(prepare) Task=`002bfaac-e9a4-4c9c-ac18-59ee398cecb2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:29:54,115::task::595::TaskManager.Task::(_updateState) Task=`002bfaac-e9a4-4c9c-ac18-59ee398cecb2`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:29:54,115::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:29:54,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:29:54,116::task::990::TaskManager.Task::(_decref) Task=`002bfaac-e9a4-4c9c-ac18-59ee398cecb2`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:29:54,136::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.0029711 s, 168 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:29:54,143::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [16aa3780]
>Thread-34::DEBUG::2014-08-21 12:29:54,144::task::595::TaskManager.Task::(_updateState) Task=`f69c4af0-22ab-4d67-97df-91b12437e84c`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:29:54,151::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:29:54,153::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9facc15f-e134-4e99-afcd-e59700087e15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:29:54,153::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:29:54,225::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:29:54,226::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`9facc15f-e134-4e99-afcd-e59700087e15`::Granted request
>Thread-34::DEBUG::2014-08-21 12:29:54,227::task::827::TaskManager.Task::(resourceAcquired) Task=`f69c4af0-22ab-4d67-97df-91b12437e84c`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:29:54,227::task::990::TaskManager.Task::(_decref) Task=`f69c4af0-22ab-4d67-97df-91b12437e84c`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:29:54,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:54,508::task::1185::TaskManager.Task::(prepare) Task=`f69c4af0-22ab-4d67-97df-91b12437e84c`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:29:54,509::task::595::TaskManager.Task::(_updateState) Task=`f69c4af0-22ab-4d67-97df-91b12437e84c`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:29:54,509::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:29:54,510::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:29:54,559::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:29:54,572::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:29:54,573::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:29:54,573::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:29:54,575::task::990::TaskManager.Task::(_decref) Task=`f69c4af0-22ab-4d67-97df-91b12437e84c`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:29:55,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:56,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.317221 s, 3.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:29:58,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:29:58,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111305 s, 9.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:00,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:00,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0985083 s, 10.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:30:02,771::task::595::TaskManager.Task::(_updateState) Task=`1b7877d2-6744-404d-bcc3-7fd613213916`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:30:02,772::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:30:02,773::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0029711', 'lastCheck': '6.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:30:02,773::task::1185::TaskManager.Task::(prepare) Task=`1b7877d2-6744-404d-bcc3-7fd613213916`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0029711', 'lastCheck': '6.7', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:30:02,774::task::595::TaskManager.Task::(_updateState) Task=`1b7877d2-6744-404d-bcc3-7fd613213916`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:30:02,804::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:30:02,805::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:30:02,806::task::990::TaskManager.Task::(_decref) Task=`1b7877d2-6744-404d-bcc3-7fd613213916`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:30:02,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:03,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.792704 s, 1.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:05,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:30:06,055::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [56d6be71]
>Thread-26::DEBUG::2014-08-21 12:30:06,099::task::595::TaskManager.Task::(_updateState) Task=`71cbffdd-0efa-4312-801e-a45b607765b8`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:30:06,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:30:06,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:30:06,129::task::1185::TaskManager.Task::(prepare) Task=`71cbffdd-0efa-4312-801e-a45b607765b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:30:06,130::task::595::TaskManager.Task::(_updateState) Task=`71cbffdd-0efa-4312-801e-a45b607765b8`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:30:06,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:30:06,130::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:30:06,132::task::990::TaskManager.Task::(_decref) Task=`71cbffdd-0efa-4312-801e-a45b607765b8`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:30:06,213::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [56d6be71]
>Thread-34::DEBUG::2014-08-21 12:30:06,224::task::595::TaskManager.Task::(_updateState) Task=`db520b41-7976-4c35-95d8-286675916805`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:30:06,235::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:30:06,242::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7a97e9d4-99d6-4ff3-8f6c-856073c89e75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:30:06,248::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:30:06,255::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:30:06,261::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`7a97e9d4-99d6-4ff3-8f6c-856073c89e75`::Granted request
>Thread-34::DEBUG::2014-08-21 12:30:06,275::task::827::TaskManager.Task::(resourceAcquired) Task=`db520b41-7976-4c35-95d8-286675916805`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:30:06,280::task::990::TaskManager.Task::(_decref) Task=`db520b41-7976-4c35-95d8-286675916805`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:30:06,382::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:06,386::task::1185::TaskManager.Task::(prepare) Task=`db520b41-7976-4c35-95d8-286675916805`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967236096', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:06,389::task::595::TaskManager.Task::(_updateState) Task=`db520b41-7976-4c35-95d8-286675916805`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:30:06,391::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:30:06,395::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:30:06,416::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:30:06,420::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:30:06,421::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:30:06,423::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-15::DEBUG::2014-08-21 12:30:06,422::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:30:06,428::task::990::TaskManager.Task::(_decref) Task=`db520b41-7976-4c35-95d8-286675916805`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:30:06,510::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000764069 s, 652 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:07,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0658431 s, 15.6 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:09,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:11,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.67454 s, 612 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:13,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:13,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0972552 s, 10.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:15,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:15,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.153817 s, 6.7 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:30:16,523::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-26::DEBUG::2014-08-21 12:30:16,524::task::595::TaskManager.Task::(_updateState) Task=`55bb96ba-0860-4fab-ac36-738e93f5c9a6`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:30:16,525::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:30:16,526::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:30:16,526::task::1185::TaskManager.Task::(prepare) Task=`55bb96ba-0860-4fab-ac36-738e93f5c9a6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:30:16,527::task::595::TaskManager.Task::(_updateState) Task=`55bb96ba-0860-4fab-ac36-738e93f5c9a6`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:30:16,527::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:30:16,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:30:16,528::task::990::TaskManager.Task::(_decref) Task=`55bb96ba-0860-4fab-ac36-738e93f5c9a6`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:30:16,560::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1f2250cc]
>Thread-34::DEBUG::2014-08-21 12:30:16,561::task::595::TaskManager.Task::(_updateState) Task=`df9ebf2d-fe7e-43c6-bc8e-250e89d30f3e`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:30:16,565::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:30:16,566::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cf6190d4-9e5b-42ad-be0b-c2a87ddc5307`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:30:16,567::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:30:16,568::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:30:16,568::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`cf6190d4-9e5b-42ad-be0b-c2a87ddc5307`::Granted request
>Thread-34::DEBUG::2014-08-21 12:30:16,569::task::827::TaskManager.Task::(resourceAcquired) Task=`df9ebf2d-fe7e-43c6-bc8e-250e89d30f3e`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:30:16,570::task::990::TaskManager.Task::(_decref) Task=`df9ebf2d-fe7e-43c6-bc8e-250e89d30f3e`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:30:16,606::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968153600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:16,607::task::1185::TaskManager.Task::(prepare) Task=`df9ebf2d-fe7e-43c6-bc8e-250e89d30f3e`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968153600', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:16,607::task::595::TaskManager.Task::(_updateState) Task=`df9ebf2d-fe7e-43c6-bc8e-250e89d30f3e`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:30:16,608::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:30:16,608::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:30:16,609::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:30:16,671::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:30:16,671::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:30:16,672::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:30:16,672::task::990::TaskManager.Task::(_decref) Task=`df9ebf2d-fe7e-43c6-bc8e-250e89d30f3e`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:30:16,926::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:30:16,943::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00134802 s, 369 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:17,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:17,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492065 s, 20.8 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:30:18,309::task::595::TaskManager.Task::(_updateState) Task=`1c8550b5-bd13-46bf-ab94-4d03df8399a9`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:30:18,310::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:30:18,310::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134802', 'lastCheck': '1.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:30:18,310::task::1185::TaskManager.Task::(prepare) Task=`1c8550b5-bd13-46bf-ab94-4d03df8399a9`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134802', 'lastCheck': '1.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:30:18,311::task::595::TaskManager.Task::(_updateState) Task=`1c8550b5-bd13-46bf-ab94-4d03df8399a9`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:30:18,311::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:30:18,311::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:30:18,312::task::990::TaskManager.Task::(_decref) Task=`1c8550b5-bd13-46bf-ab94-4d03df8399a9`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:30:19,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:20,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0572578 s, 17.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:22,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:22,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.129702 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:24,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:24,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.149215 s, 6.9 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:26,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:30:26,774::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-26::DEBUG::2014-08-21 12:30:26,775::task::595::TaskManager.Task::(_updateState) Task=`46960df7-447e-42cb-a586-17f687eca353`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:30:26,776::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:30:26,777::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:30:26,778::task::1185::TaskManager.Task::(prepare) Task=`46960df7-447e-42cb-a586-17f687eca353`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:30:26,778::task::595::TaskManager.Task::(_updateState) Task=`46960df7-447e-42cb-a586-17f687eca353`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:30:26,778::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:30:26,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:30:26,779::task::990::TaskManager.Task::(_decref) Task=`46960df7-447e-42cb-a586-17f687eca353`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:30:26,786::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64218648]
>Thread-34::DEBUG::2014-08-21 12:30:26,788::task::595::TaskManager.Task::(_updateState) Task=`7e0fd66b-35ef-46f7-a30c-03ffd1590665`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:30:26,789::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:30:26,790::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4dd92435-2439-4472-9b22-fe991b38561b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:30:26,790::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:30:26,791::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:30:26,791::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`4dd92435-2439-4472-9b22-fe991b38561b`::Granted request
>Thread-34::DEBUG::2014-08-21 12:30:26,794::task::827::TaskManager.Task::(resourceAcquired) Task=`7e0fd66b-35ef-46f7-a30c-03ffd1590665`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:30:26,795::task::990::TaskManager.Task::(_decref) Task=`7e0fd66b-35ef-46f7-a30c-03ffd1590665`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:30:26,808::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:26,808::task::1185::TaskManager.Task::(prepare) Task=`7e0fd66b-35ef-46f7-a30c-03ffd1590665`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:26,808::task::595::TaskManager.Task::(_updateState) Task=`7e0fd66b-35ef-46f7-a30c-03ffd1590665`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:30:26,808::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:30:26,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:30:26,809::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:30:26,810::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:30:26,810::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:30:26,811::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:30:26,811::task::990::TaskManager.Task::(_decref) Task=`7e0fd66b-35ef-46f7-a30c-03ffd1590665`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:30:27,038::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:30:27,071::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00762825 s, 65.3 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:27,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.113739 s, 9.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:29,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:30,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.31096 s, 781 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:32,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:32,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047752 s, 21.4 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:30:33,570::task::595::TaskManager.Task::(_updateState) Task=`f743f866-c652-470d-8ad9-f48e6ce227cb`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:30:33,571::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:30:33,571::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00762825', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:30:33,571::task::1185::TaskManager.Task::(prepare) Task=`f743f866-c652-470d-8ad9-f48e6ce227cb`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00762825', 'lastCheck': '6.5', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:30:33,572::task::595::TaskManager.Task::(_updateState) Task=`f743f866-c652-470d-8ad9-f48e6ce227cb`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:30:33,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:30:33,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:30:33,573::task::990::TaskManager.Task::(_decref) Task=`f743f866-c652-470d-8ad9-f48e6ce227cb`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:30:35,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:30:37,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-26::DEBUG::2014-08-21 12:30:37,050::task::595::TaskManager.Task::(_updateState) Task=`2e8e791a-fd9f-483f-94f1-b47a0029f4fe`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:30:37,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:30:37,053::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:30:37,082::task::1185::TaskManager.Task::(prepare) Task=`2e8e791a-fd9f-483f-94f1-b47a0029f4fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:30:37,082::task::595::TaskManager.Task::(_updateState) Task=`2e8e791a-fd9f-483f-94f1-b47a0029f4fe`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:30:37,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:30:37,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:30:37,083::task::990::TaskManager.Task::(_decref) Task=`2e8e791a-fd9f-483f-94f1-b47a0029f4fe`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:30:37,094::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5776da7a]
>Thread-34::DEBUG::2014-08-21 12:30:37,098::task::595::TaskManager.Task::(_updateState) Task=`83cac34d-4fa1-4981-acf1-7c28709ef82f`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:30:37,099::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:30:37,101::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0b3a9e1f-2111-4103-bde0-5d61d20fa1c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:30:37,102::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:30:37,109::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:30:37,109::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0b3a9e1f-2111-4103-bde0-5d61d20fa1c2`::Granted request
>Thread-34::DEBUG::2014-08-21 12:30:37,117::task::827::TaskManager.Task::(resourceAcquired) Task=`83cac34d-4fa1-4981-acf1-7c28709ef82f`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:30:37,118::task::990::TaskManager.Task::(_decref) Task=`83cac34d-4fa1-4981-acf1-7c28709ef82f`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:30:37,134::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 12:30:37,146::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:37,154::task::1185::TaskManager.Task::(prepare) Task=`83cac34d-4fa1-4981-acf1-7c28709ef82f`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968088064', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:37,160::task::595::TaskManager.Task::(_updateState) Task=`83cac34d-4fa1-4981-acf1-7c28709ef82f`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:30:37,165::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:30:37,170::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:30:37,178::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-15::DEBUG::2014-08-21 12:30:37,183::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000776891 s, 641 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:30:37,183::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:30:37,188::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:30:37,190::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:30:37,194::task::990::TaskManager.Task::(_decref) Task=`83cac34d-4fa1-4981-acf1-7c28709ef82f`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:30:37,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.14092 s, 478 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:39,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:39,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119863 s, 8.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:41,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:43,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.25442 s, 454 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:45,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:46,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.198461 s, 5.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:30:47,225::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:30:47,243::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-26::DEBUG::2014-08-21 12:30:47,248::task::595::TaskManager.Task::(_updateState) Task=`8bd91c37-ab2a-4856-8907-678ff8efaa3b`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:30:47,251::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:30:47,254::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:30:47,256::task::1185::TaskManager.Task::(prepare) Task=`8bd91c37-ab2a-4856-8907-678ff8efaa3b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-15::DEBUG::2014-08-21 12:30:47,258::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00168085 s, 296 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:30:47,259::task::595::TaskManager.Task::(_updateState) Task=`8bd91c37-ab2a-4856-8907-678ff8efaa3b`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:30:47,261::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:30:47,261::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:30:47,262::task::990::TaskManager.Task::(_decref) Task=`8bd91c37-ab2a-4856-8907-678ff8efaa3b`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:30:47,267::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [75eed716]
>Thread-34::DEBUG::2014-08-21 12:30:47,268::task::595::TaskManager.Task::(_updateState) Task=`2bc6d046-52f8-44a5-813d-b96066873ca1`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:30:47,268::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:30:47,269::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`264ca1b2-7f41-4b23-9fb9-6afeaace13d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:30:47,269::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:30:47,269::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:30:47,270::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`264ca1b2-7f41-4b23-9fb9-6afeaace13d3`::Granted request
>Thread-34::DEBUG::2014-08-21 12:30:47,270::task::827::TaskManager.Task::(resourceAcquired) Task=`2bc6d046-52f8-44a5-813d-b96066873ca1`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:30:47,271::task::990::TaskManager.Task::(_decref) Task=`2bc6d046-52f8-44a5-813d-b96066873ca1`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:30:47,274::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:47,274::task::1185::TaskManager.Task::(prepare) Task=`2bc6d046-52f8-44a5-813d-b96066873ca1`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:47,275::task::595::TaskManager.Task::(_updateState) Task=`2bc6d046-52f8-44a5-813d-b96066873ca1`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:30:47,275::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:30:47,275::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:30:47,276::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:30:47,276::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:30:47,276::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:30:47,276::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:30:47,277::task::990::TaskManager.Task::(_decref) Task=`2bc6d046-52f8-44a5-813d-b96066873ca1`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:30:48,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-26::DEBUG::2014-08-21 12:30:50,414::task::595::TaskManager.Task::(_updateState) Task=`e9eff2f1-331b-452b-8f4b-9ab9bd864228`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:30:50,417::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:30:50,418::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168085', 'lastCheck': '3.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:30:50,421::task::1185::TaskManager.Task::(prepare) Task=`e9eff2f1-331b-452b-8f4b-9ab9bd864228`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168085', 'lastCheck': '3.2', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:30:50,422::task::595::TaskManager.Task::(_updateState) Task=`e9eff2f1-331b-452b-8f4b-9ab9bd864228`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:30:50,423::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:30:50,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:30:50,427::task::990::TaskManager.Task::(_decref) Task=`e9eff2f1-331b-452b-8f4b-9ab9bd864228`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:30:50,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.153896 s, 6.7 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:52,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:52,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0816862 s, 12.5 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:30:54,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:30:55,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.340032 s, 3.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-08-21 12:30:58,998::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-13::DEBUG::2014-08-21 12:30:59,000::task::595::TaskManager.Task::(_updateState) Task=`befb8038-87e0-4349-b8a9-8cd1734ae48b`::moving from state init -> state preparing
>Thread-13::INFO::2014-08-21 12:30:59,000::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-13::INFO::2014-08-21 12:30:59,001::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:30:59,001::task::1185::TaskManager.Task::(prepare) Task=`befb8038-87e0-4349-b8a9-8cd1734ae48b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-13::DEBUG::2014-08-21 12:30:59,001::task::595::TaskManager.Task::(_updateState) Task=`befb8038-87e0-4349-b8a9-8cd1734ae48b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-08-21 12:30:59,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-08-21 12:30:59,002::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-08-21 12:30:59,005::task::990::TaskManager.Task::(_decref) Task=`befb8038-87e0-4349-b8a9-8cd1734ae48b`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:30:59,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:30:59,130::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [629628f9]
>Thread-34::DEBUG::2014-08-21 12:30:59,132::task::595::TaskManager.Task::(_updateState) Task=`ac0e4ec0-7638-4a91-b201-8beaab1739e4`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:30:59,280::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:30:59,425::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b34a1b7c-b7d5-4372-988d-3bbe071b681c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:30:59,425::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:30:59,426::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:30:59,427::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`b34a1b7c-b7d5-4372-988d-3bbe071b681c`::Granted request
>Thread-34::DEBUG::2014-08-21 12:30:59,428::task::827::TaskManager.Task::(resourceAcquired) Task=`ac0e4ec0-7638-4a91-b201-8beaab1739e4`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:30:59,428::task::990::TaskManager.Task::(_decref) Task=`ac0e4ec0-7638-4a91-b201-8beaab1739e4`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:30:59,905::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:59,906::task::1185::TaskManager.Task::(prepare) Task=`ac0e4ec0-7638-4a91-b201-8beaab1739e4`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535968219136', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:30:59,907::task::595::TaskManager.Task::(_updateState) Task=`ac0e4ec0-7638-4a91-b201-8beaab1739e4`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:30:59,907::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:30:59,908::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:30:59,909::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:30:59,909::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:30:59,910::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:31:00,068::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:31:00,069::task::990::TaskManager.Task::(_decref) Task=`ac0e4ec0-7638-4a91-b201-8beaab1739e4`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:31:00,227::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:31:00,340::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00741697 s, 67.1 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:31:00,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.24681 s, 821 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:31:02,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:02,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0540311 s, 19.0 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:31:04,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:05,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.316556 s, 3.2 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:31:07,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:08,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.4018 s, 730 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:31:08,688::task::595::TaskManager.Task::(_updateState) Task=`dce133c6-ca04-4f2e-9f13-ca8ddf0d49e1`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:31:08,689::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:31:08,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00741697', 'lastCheck': '8.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:31:08,690::task::1185::TaskManager.Task::(prepare) Task=`dce133c6-ca04-4f2e-9f13-ca8ddf0d49e1`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00741697', 'lastCheck': '8.3', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:31:08,690::task::595::TaskManager.Task::(_updateState) Task=`dce133c6-ca04-4f2e-9f13-ca8ddf0d49e1`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:31:08,691::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:31:08,691::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:31:08,691::task::990::TaskManager.Task::(_decref) Task=`dce133c6-ca04-4f2e-9f13-ca8ddf0d49e1`::ref 0 aborting False
>Thread-26::DEBUG::2014-08-21 12:31:10,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-26::DEBUG::2014-08-21 12:31:10,425::task::595::TaskManager.Task::(_updateState) Task=`081409ea-1119-499c-861f-9bbce067134a`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:31:10,426::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:31:10,426::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:31:10,427::task::1185::TaskManager.Task::(prepare) Task=`081409ea-1119-499c-861f-9bbce067134a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:31:10,427::task::595::TaskManager.Task::(_updateState) Task=`081409ea-1119-499c-861f-9bbce067134a`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:31:10,427::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:31:10,427::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:31:10,428::task::990::TaskManager.Task::(_decref) Task=`081409ea-1119-499c-861f-9bbce067134a`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:31:10,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:31:10,460::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [aa2d7ea]
>Thread-15::DEBUG::2014-08-21 12:31:10,469::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00277215 s, 180 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-08-21 12:31:10,474::task::595::TaskManager.Task::(_updateState) Task=`099ebfe5-5f08-4648-910b-5467c9995f4d`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:31:10,481::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:31:10,490::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1f8bba8f-5950-462e-9942-37f6ab7f26ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:31:10,495::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:31:10,503::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:31:10,508::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`1f8bba8f-5950-462e-9942-37f6ab7f26ed`::Granted request
>Thread-34::DEBUG::2014-08-21 12:31:10,516::task::827::TaskManager.Task::(resourceAcquired) Task=`099ebfe5-5f08-4648-910b-5467c9995f4d`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:31:10,516::task::990::TaskManager.Task::(_decref) Task=`099ebfe5-5f08-4648-910b-5467c9995f4d`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:31:10,522::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:31:10,523::task::1185::TaskManager.Task::(prepare) Task=`099ebfe5-5f08-4648-910b-5467c9995f4d`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967825920', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:31:10,523::task::595::TaskManager.Task::(_updateState) Task=`099ebfe5-5f08-4648-910b-5467c9995f4d`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:31:10,523::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:31:10,524::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:31:10,524::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:31:10,525::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:31:10,525::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:31:10,525::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:31:10,526::task::990::TaskManager.Task::(_decref) Task=`099ebfe5-5f08-4648-910b-5467c9995f4d`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:31:13,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:13,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0592153 s, 17.3 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:31:15,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:18,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 2.8114 s, 364 kB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:31:20,556::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-26::DEBUG::2014-08-21 12:31:20,558::task::595::TaskManager.Task::(_updateState) Task=`69ccd6ba-6f30-4bec-837f-175238a63a75`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:31:20,558::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:31:20,559::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:31:20,559::task::1185::TaskManager.Task::(prepare) Task=`69ccd6ba-6f30-4bec-837f-175238a63a75`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:31:20,559::task::595::TaskManager.Task::(_updateState) Task=`69ccd6ba-6f30-4bec-837f-175238a63a75`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:31:20,559::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:31:20,559::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:31:20,560::task::990::TaskManager.Task::(_decref) Task=`69ccd6ba-6f30-4bec-837f-175238a63a75`::ref 0 aborting False
>Thread-34::DEBUG::2014-08-21 12:31:20,565::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [71303c04]
>Thread-34::DEBUG::2014-08-21 12:31:20,566::task::595::TaskManager.Task::(_updateState) Task=`d3fb8882-f756-4e20-980c-4b0ee7798236`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:31:20,567::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:31:20,568::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0ee3bc45-c819-4e5e-99f7-ffc34dbce72d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:31:20,568::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:31:20,569::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:31:20,569::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`0ee3bc45-c819-4e5e-99f7-ffc34dbce72d`::Granted request
>Thread-34::DEBUG::2014-08-21 12:31:20,569::task::827::TaskManager.Task::(resourceAcquired) Task=`d3fb8882-f756-4e20-980c-4b0ee7798236`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:31:20,570::task::990::TaskManager.Task::(_decref) Task=`d3fb8882-f756-4e20-980c-4b0ee7798236`::ref 1 aborting False
>Thread-34::INFO::2014-08-21 12:31:20,573::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:31:20,574::task::1185::TaskManager.Task::(prepare) Task=`d3fb8882-f756-4e20-980c-4b0ee7798236`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967891456', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:31:20,574::task::595::TaskManager.Task::(_updateState) Task=`d3fb8882-f756-4e20-980c-4b0ee7798236`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:31:20,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:31:20,575::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:31:20,575::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:31:20,576::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:31:20,576::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:31:20,576::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:31:20,577::task::990::TaskManager.Task::(_decref) Task=`d3fb8882-f756-4e20-980c-4b0ee7798236`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:31:20,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:20,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.072578 s, 14.1 MB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:31:22,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:23,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0961141 s, 10.7 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-08-21 12:31:23,667::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-15::DEBUG::2014-08-21 12:31:23,683::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.000654884 s, 760 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:31:25,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:26,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.991407 s, 1.0 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:31:27,742::task::595::TaskManager.Task::(_updateState) Task=`9c5c91d3-e33c-40d6-a0ff-020560587dec`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:31:28,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-26::INFO::2014-08-21 12:31:28,048::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654884', 'lastCheck': '4.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:31:28,065::task::1185::TaskManager.Task::(prepare) Task=`9c5c91d3-e33c-40d6-a0ff-020560587dec`::finished: {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654884', 'lastCheck': '4.4', 'valid': True}}
>Thread-26::DEBUG::2014-08-21 12:31:28,094::task::595::TaskManager.Task::(_updateState) Task=`9c5c91d3-e33c-40d6-a0ff-020560587dec`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:31:28,101::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:31:28,115::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:31:28,123::task::990::TaskManager.Task::(_decref) Task=`9c5c91d3-e33c-40d6-a0ff-020560587dec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:31:28,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:29,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.479481 s, 2.1 MB/s\n'; <rc> = 0
>Thread-26::DEBUG::2014-08-21 12:31:30,624::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-26::DEBUG::2014-08-21 12:31:30,625::task::595::TaskManager.Task::(_updateState) Task=`7c8bf12c-e2fa-4697-bbd9-c74ba40297ec`::moving from state init -> state preparing
>Thread-26::INFO::2014-08-21 12:31:30,626::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-26::INFO::2014-08-21 12:31:30,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:31:30,636::task::1185::TaskManager.Task::(prepare) Task=`7c8bf12c-e2fa-4697-bbd9-c74ba40297ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 36}}
>Thread-26::DEBUG::2014-08-21 12:31:30,636::task::595::TaskManager.Task::(_updateState) Task=`7c8bf12c-e2fa-4697-bbd9-c74ba40297ec`::moving from state preparing -> state finished
>Thread-26::DEBUG::2014-08-21 12:31:30,637::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-26::DEBUG::2014-08-21 12:31:30,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-26::DEBUG::2014-08-21 12:31:30,637::task::990::TaskManager.Task::(_decref) Task=`7c8bf12c-e2fa-4697-bbd9-c74ba40297ec`::ref 0 aborting False
>Dummy-33::DEBUG::2014-08-21 12:31:32,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-34::DEBUG::2014-08-21 12:31:33,433::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3feaa0f2]
>Thread-34::DEBUG::2014-08-21 12:31:33,495::task::595::TaskManager.Task::(_updateState) Task=`f0cd6e91-44e7-4f7b-b41b-09b068eb719b`::moving from state init -> state preparing
>Thread-34::INFO::2014-08-21 12:31:33,496::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', options=None)
>Thread-34::DEBUG::2014-08-21 12:31:33,497::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3fa7ce27-5a43-4f86-8ab6-9122b09e2b5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo'
>Thread-34::DEBUG::2014-08-21 12:31:33,498::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' for lock type 'shared'
>Thread-34::DEBUG::2014-08-21 12:31:33,499::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free. Now locking as 'shared' (1 active user)
>Thread-34::DEBUG::2014-08-21 12:31:33,499::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8`ReqID=`3fa7ce27-5a43-4f86-8ab6-9122b09e2b5e`::Granted request
>Thread-34::DEBUG::2014-08-21 12:31:39,014::task::827::TaskManager.Task::(resourceAcquired) Task=`f0cd6e91-44e7-4f7b-b41b-09b068eb719b`::_resourcesAcquired: Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8 (shared)
>Thread-34::DEBUG::2014-08-21 12:31:39,797::task::990::TaskManager.Task::(_decref) Task=`f0cd6e91-44e7-4f7b-b41b-09b068eb719b`::ref 1 aborting False
>Thread-15::DEBUG::2014-08-21 12:31:39,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__rhev__stress_sd__142/664aab68-c780-4f9b-9553-a35e801fdb8b/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::INFO::2014-08-21 12:31:39,962::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:31:39,967::task::1185::TaskManager.Task::(prepare) Task=`f0cd6e91-44e7-4f7b-b41b-09b068eb719b`::finished: {'info': {'name': 'TEST_DC_142', 'isoprefix': '', 'pool_status': 'connected', 'lver': 36, 'domains': '664aab68-c780-4f9b-9553-a35e801fdb8b:Active', 'master_uuid': '664aab68-c780-4f9b-9553-a35e801fdb8b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'664aab68-c780-4f9b-9553-a35e801fdb8b': {'status': 'Active', 'diskfree': '535967498240', 'isoprefix': '', 'alerts': [], 'disktotal': '536870912000', 'version': 3}}}
>Thread-34::DEBUG::2014-08-21 12:31:39,971::task::595::TaskManager.Task::(_updateState) Task=`f0cd6e91-44e7-4f7b-b41b-09b068eb719b`::moving from state preparing -> state finished
>Thread-34::DEBUG::2014-08-21 12:31:39,974::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8': < ResourceRef 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', isValid: 'True' obj: 'None'>}
>Thread-34::DEBUG::2014-08-21 12:31:39,977::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-34::DEBUG::2014-08-21 12:31:39,986::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8'
>Thread-34::DEBUG::2014-08-21 12:31:39,990::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' (0 active users)
>Thread-34::DEBUG::2014-08-21 12:31:39,993::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8' is free, finding out if anyone is waiting for it.
>Thread-34::DEBUG::2014-08-21 12:31:39,997::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.80a3d808-3945-4db3-91ed-9a8fd0e1e9f8', Clearing records.
>Thread-34::DEBUG::2014-08-21 12:31:40,002::task::990::TaskManager.Task::(_decref) Task=`f0cd6e91-44e7-4f7b-b41b-09b068eb719b`::ref 0 aborting False
>Thread-15::DEBUG::2014-08-21 12:31:40,013::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n498 bytes (498 B) copied, 0.00105076 s, 474 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:31:40,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 6.7922 s, 151 kB/s\n'; <rc> = 0
>Dummy-33::DEBUG::2014-08-21 12:31:42,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/80a3d808-3945-4db3-91ed-9a8fd0e1e9f8/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-33::DEBUG::2014-08-21 12:31:47,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 4.27657 s, 239 kB/s\n'; <rc> = 0

Actions: View

Attachments on bug 1132452: 929174 | 929175